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Preface 


This book consists of ten weeks of material given as a course on ordinary 
differential equations (ODEs) for second year mathematics majors at the 
University of Bristol. It is the first course devoted solely to differential 
equations that these students will take. An obvious question is “why does 
there need to be another textbook on ODEs”? From one point of view the 
answer is certainly that it is not needed. The classic textbooks of Cod- 
dington and Levinson, Hale, and Hartman! provide a thorough exposition 
of the topic and are essential references for mathematicians, scientists and 
engineers who encounter and must understand ODEs in the course of their 
research. However, these books are not ideal for use as a textbook for a 
student’s first exposure to ODEs beyond the basic calculus course (more on 
that shortly). Their depth and mathematical thoroughness often leave stu- 
dents that are relatively new to the topic feeling overwhelmed and grasping 
for the essential ideas within the topics that are covered. Of course, (prob- 
ably) no one would consider using these texts for a second year course in 
ODEs. That’s not really an issue, and there is a large market for ODE texts 
for second year mathematics students (and new texts continue to appear 
each year). I spent some time examining some of these texts (many which 
sell for well over a hundred dollars) and concluded that none of them really 
would “work” for the course that I wanted to deliver. So, I decided to 
write my own notes, which has turned into this small book. I have taught 


1B. A. Coddington and N. Levinson. Theory of Ordinary Differential Equations. 
Krieger, 1984; J. K. Hale. Ordinary Differential Equations. Dover, 2009; and 
P. Hartman. Ordinary Differential Equations. Society for Industrial and Applied Math- 
ematics, 2002. 
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this course for three years now. There are typically about 160 students in 
the class, in their second year, and I have been somewhat surprised, and 
pleased, by how the course has been received by the students. So now I will 
explain a bit about my rationale, requirements, and goals for the course. 

In the UK students come to University to study mathematics with a 
good background in calculus and linear algebra. Many have “seen” some 
basic ODEs already. In their first year, students have a year long course in 
calculus where they encounter the typical first order ODEs, second order 
linear constant coefficient ODEs, and two-dimensional first order linear 
matrix ODEs. This material tends to form a substantial part of the tra- 
ditional second year course in ODEs and since I can consider the material 
as “already seen, at least, once”, it allows me to develop the course in a 
way that makes contact with more contemporary concepts in ODEs and 
to touch on a variety of research issues. This is very good for our program 
since many students will do substantial projects that approach research 
level and require varying amounts of knowledge of ODEs. 

This book consists of 10 chapters, and the course is 12 weeks long. Each 
chapter is covered in a week, and in the remaining two weeks I summarize 
the entire course, answer lots of questions, and prepare the students for 
the exam. I do not cover the material in the appendices in the lectures. 
Some of it is basic material that the students have already seen that I 
include for completeness and other topics are “tasters” for more advanced 
material that students will encounter in later courses or in their project 
work. Students are very curious about the notion of “chaos”, and I have 
included some material in an appendix on that concept. The focus in that 
appendix is only to connect it with ideas that have been developed in this 
course related to ODEs and to prepare them for more advanced courses in 
dynamical systems and ergodic theory that are available in their third and 
fourth years. 

There is a significant transition from first to second year mathematics at 
Bristol. For example, the first year course in calculus teaches a large num- 
ber of techniques for performing analytical computations, e.g. the usual 
set of tools for computing derivatives and integrals of functions of one, and 
more variables. Armed with a large set of computational skills, the second 
year makes the transition to “thinking about mathematics” and “creating 
mathematics”. The course in ODEs is ideal for making this transition. It 
is a course in ordinary differential “equations”, and equations are what 
mathematicians learn how to solve. It follows then that students take the 
course with the expectation of learning how to solve ODEs. Therefore it 
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is a bit disconcerting when I tell them that it is likely that almost all of 
the ODEs that they encounter throughout their career as a mathematician 
will not have analytical solutions. Moreover, even if they do have analyti- 
cal solutions the complexity of the analytical solutions, even for “simple” 
ODEs, is not likely to yield much insight into the nature of the behavior 
of the solutions of ODEs. This last statement provides the entry into the 
nature of the course, which is based on the “vision of Poincaré” — rather 
than seeking to find specific solutions of ODEs, we seek to understand how 
all possible solutions are related in their behavior in the geometrical set- 
ting of phase space. In other words, this course has been designed to be a 
beginning course in ODEs from the dynamical systems point of view. 

I am grateful to all of the students who have taken this course over the 
past few years. Teaching this particular course has been a very rewarding 
experience for me and I very much enjoyed discussing this material with 
them during office hours. 

While this book originated during my time in the city of Bristol, United 
Kingdom, I have completed it in the past few months during my stay at the 
United States Naval Academy in Annapolis, Maryland. During this time I 
have used the book in teaching the course $M222, Differential Equations 
with Matrices. This is a second year course at the Naval Academy and 
the students have all had three courses in calculus, and most have had a 
one semester course in matrix theory. This was an adequate background 
and I was very happy with the student engagement with the course. Discus- 
sions with midshipmen Luke Artz, Brown Bedard, Thomas (Cohen) Bruner, 
Alexander (Alex) Coelho, Natali Dilts, Bianka Harris, Haley Harris, Francis 
(Frank) Hollahan, Sarabeth Joyner, Emilyrose Kosanovich, George Main, 
Rocco Patel, and Aurora Sandoval contributed to the refinement of expla- 
nations in many sections as well as the inclusion of quite a few new exercises. 
Iam grateful for their input. Finally, I am very grateful for the support of 
the William R. Davis ’68 Chair in the Department of Mathematics at the 
United States Naval Academy. 
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Chapter 1 


Getting Started: The Language 
of ODEs 


THIS IS A COURSE ABOUT ORDINARY DIFFERENTIAL EQUATIONS (ODEs). 
So we begin by defining what we mean by this term.! 


Definition 1 (Ordinary differential equation). An ordinary differ- 
ential equation (ODE) is an equation for a function of one variable that 
involves (“ordinary”) derivatives of the function (and, possibly, known func- 
tions of the same variable). 


We give several examples below: 


2. Gr — axG —a4+23 =sinut, 


1The material in these lectures can be found in most textbooks on ODEs. It con- 
sists mainly of terminology and definitions. Generally such “defintion and terminology” 
introductions can be tedious and a bit boring. We probably have not entirely avoided 
that trap, but the material does introduce much of the essential language and some 
concepts that permeate the rest of the course. If you skip it, you will need to come back 
to it. 
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ODEs can be succinctly written by adopting a more compact notation 
for the derivatives. We rewrite the examples above with this shorthand 
notation. 


E+wsr =0, 

#— art —2+2° = sinuwt, 
#—p(l—2?)¢+2=0, 

f" + F" + BA — (f")?) =0, 
Oa + gy! aie > =0. 


SP ee 


Now that we have defined the notion of an ODE, we will need to develop 
some additional concepts in order to more deeply describe the structure of 
ODEs. The notions of “structure” are important since we will see that they 
play a key role in how we understand the nature of the behavior of solutions 
of ODEs. 


Definition 2 (Dependent variable). The value of the function, e.g. for 
Example 1, x(t). 


Definition 3 (Independent variable). The argument of the function, 
e.g. for Example 1, t. 


We summarize a list of the dependent and independent variables in the 
five examples of ODEs given above. 


Table 1.1. Identifying the independent and dependent 
variables for several examples. 


Example Dependent variable Independent variable 


oR WN FR 


t 
t 
t 
u 
x 


ees s 


The notion of “order” is an important characteristic of ODEs. 


Definition 4 (Order of an ODE). The number associated with the 
largest derivative of the dependent variable in the ODE. 


We give the order of each of the ODEs in the five examples above. 
Distinguishing between the independent and dependent variables 
enables us to define the notion of autonomous and nonautonomous ODEs. 
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Table 1.2. Identifying the order of the ODE for 
several examples. 


Example Order 


second order 
second order 
second order 
third order 
fourth order 


oR WN EH 


Definition 5 (Autonomous, Nonautonomous). An ODE is said to 
be autonomous if none of the coefficients (i.e. functions) multiplying the 
dependent variable, or any of its derivatives, depend explicitly on the inde- 
pendent variable, and also if no terms not depending on the dependent 
variable or any of its derivatives depend explicitly on the independent vari- 
able. Otherwise, it is said to be nonautonomous. 


Or, more succinctly, an ODE is autonomous if the independent variable 
does not explicitly appear in the equation. Otherwise, it is nonautonomous. 

We apply this definition to the five examples above, and summarize the 
results in the table below: 


Table 1.3. Identifying autonomous and nonau- 
tonomous ODEs for several examples. 


Example 
t autonomous 
2 nonautonomous 
3 autonomous 
4 autonomous 
5 nonautonomous 


All scalar ODEs, i.e. the value of the dependent variable is a scalar, can 
be written as first order equations where the new dependent variable is a 
vector having the same dimension as the order of the ODE. This is done by 
constructing a vector whose components consist of the dependent variable 
and all of its derivatives are below the highest order. This vector is the new 
dependent variable. We illustrate this for the five examples above. 


i, 


b=-w's, (2,v)€E RXR. 


or 


or 


or 
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L=v, 


’=arv+a—az*+sinwt, (2,v) eC RxR. 


L=v, 


o=p(l—2?)v—a2, (2,v)E RXR. 


Rae 
lI 
es 


bi v 
v l= u , (f,v,uERxRxR. 
w)  \-fu- aw) 
y =w, 
y" =, 
yl = U, 
yl" ae —g?y" = faa 
y' =, 
uf =y" =», 
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or 
/ 
y w 
: v 
_/ |= , (yw,v,uEeRxRxRxR. 
U UW 
u! —ay — x° 


Therefore without loss of generality, the general form of the ODE that 
we will study can be expressed as a first order vector ODE: 


&= f(x), x(to)=2%0, «x ER", autonomous, (1.1) 
&=f(x,t), x(to)=20 x €R"”, nonautonomous, (1.2) 


where x(to) = 2 is referred to as the initial condition. 

This first order vector form of ODEs allows us to discuss many proper- 
ties of ODEs in a way that is independent of the order of the ODE. It also 
lends itself to a natural geometrical description of the solutions of ODEs 
that we will see shortly. 

A key characteristic of ODEs is whether or not they are linear or non- 
linear. 


Definition 6 (Linear and Nonlinear ODEs). An ODE is said to be 
linear if it is a linear function of the dependent variable. If it is not linear, 
it is said to be nonlinear. 


Note that the independent variable does not play a role in whether or 
not the ODE is linear or nonlinear. 


Table 1.4. Identifying linear and nonlinear 
ODEs for several examples. 


Example 
1 linear 
2 nonlinear 
3 nonlinear 
4 nonlinear 
5 linear 


When written as a first order vector equation the (vector) space of 
dependent variables is referred to as the phase space of the ODE. The 
ODE then has the geometric interpretation as a vector field on phase space. 
The structure of phase space, e.g. its dimension and geometry, can have a 
significant influence on the nature of solutions of ODEs. We will encounter 
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ODEs defined on different types of phase space, and of different dimensions. 
Some examples are given in the following lists. 


1-dimension 


1. R — the real line, 
2. IC R — an interval on the real line, 
3. S! — the circle. 


“Solving” One-dimensional Autonomous ODEs. Formally (we will explain 
what that means shortly) an expression for the solution of a one- 
dimensional autonomous ODE can be obtained by integration. We explain 
how this is done, and what it means. Let P denote one of the one- 
dimensional phase spaces described above. We consider the autonomous 
vector field defined on P as follows: 

. at 


aH Tf), ato)=t0, xe P. (1.3) 
This is an example of a one-dimensional separable ODE which can be writ- 


ten as follows: 
a(t) da! t 
—~ = | dt’ =t—to. (1.4) 
[.. f(2’) [ 


If we can compute the integral on the left-hand side of (1.4), then it may 
be possible to solve for z(t). However, we know that not all functions IO} 
can be integrated. This is what we mean by we can “formally” solve for 
the solution for this example. We may not be able to represent the solution 


in a form that is useful. 


The higher dimensional phase spaces that we will consider will be con- 
structed as Cartesian products of these three basic one-dimensional phase 
spaces. 
2-dimensions 
R? = R x R — the plane, 

T? =S x S — the two torus, 
C =IxS — the (finite) cylinder, 
C =RxS — the (infinite) cylinder. 


PE 


In many applications of ODEs the independent variable has the inter- 
pretation of time, which is why the variable t is often used to denote the 
independent variable. Dynamics is the study of how systems change in 
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time. When written as a first order system ODEs are often referred to as 
dynamical systems, and ODEs are said to generate vector fields on phase 
space. For this reason the phrases ODE and vector field tend to be used 
synonomously. Moreover, this geometrical view leads to an alternate, but 
synonomous, terminology for solutions of ODEs. In particular, solutions of 
ODEs may be referred to as trajectories or orbits. 

Several natural questions arise when analyzing an ODE. “Does the 
ODE have a solution?” “Are solutions unique?” (And what does “unique” 
mean?) The standard way of treating this in an ODE course is to “prove a 
big theorem” about existence and uniqueness. Rather, than do that (you 
can find the proof in hundreds of books, as well as in many sites on the 
internet), we will consider some examples that illustrate the main issues 
concerning what these questions mean, and afterwards we will describe 
sufficent conditions for an ODE to have a unique solution (and then con- 
sider what “uniqueness” means). 

First, do ODEs have solutions? Not necessarily, as the following exam- 
ple shows. 


Example 1 (An example of an ODE that has no solutions). 
Consider the following ODE defined on R: 


e+e?+?=-1, ceR. 


This ODE has no solutions since the left-hand side is non-negative and the 
right-hand side is strictly negative. 


Then you can ask the question — “if the ODE has solutions, are they 
unique?” Again, the answer is “not necessarily”, as the following example 
shows. 


Example 2 (An example illustrating the meaning of uniqueness). 
t=azr, LER, (1.5) 

where a is an arbitrary constant. The solution is given by 
ot) =ce™. (1.6) 


So we see that there are an infinite number of solutions, depending upon 
the choice of the constant c. So what could uniqueness of solutions mean? 
If we evaluate the solution (1.6) at t = 0 we see that 


x(0) =e. (1.7) 
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Substituting this into the solution (1.6), the solution has the form: 
x(t) = x(0)e™. (1.8) 


From the form of (1.8) we can see exactly what “uniquess of solutions” 
means. For a given initial condition, there is exactly one solution of the 
ODE satisfying that initial condition. 


Example 3. An example of an ODE with non-unique solutions. 
Consider the following ODE defined on R: 


&=303, 2(0)=0, «eR. (1.9) 


It is easy to see that a solution satisfying «(0) = 0 is a = 0. However, one 
can verify directly by substituting into the equation that the following is 
also a solution satisfying «(0) = 0: 


0, t<a 
x(t) = (1.10) 


(t—a)?, t>a 


for any a > 0. Hence, in this example, there are an infinite number of 
solutions satisfying the same initial condition. This example illustrates pre- 
cisely what we mean by uniqueness. Given an initial condition, only one 
(“uniqueness”) solution satisfies the initial condition at the chosen initial 
time. 


There is another question that comes up. If we have a unique solution 
does it exist for all time? Not necessarily, as the following example shows. 


Example 4. An example of an ODE with unique solutions that exists only 
for a finite time. 
Consider the following ODE on R: 


zt=a2", 2«(0)=2, ceER. (1.11) 


We can easily integrate this equation (it is separable) to obtain the following 
solution satisfying the initial condition: 
x(t) 


a 1 — Zot 


(1.12) 
The solution becomes infinite, or “does not exist” or “blows up” at one 
This is what “does not exist” means. So the solution only exists for a finite 
time, and this “time of existence” depends on the initial condition. 
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These three examples contain the essence of the “existence issues” for 
ODEs that will concern us. They are the “standard examples” that can be 
found in many textbooks.?’? 

Now we will state the standard “existence and uniqueness” theorem 
for ODEs. The statement is an example of the power and flexibility of 
expressing a general ODE as a first order vector equation. The statement 
is valid for any (finite) dimension. 

We consider the general vector field on R” 


t= f(a,t), x(to)=220, 2 ER”. (1.13) 


It is important to be aware that for the general result we are going to state it 
does not matter whether or not the ODE is autonomous or nonautonomous. 

We define the domain of the vector field. Let U Cc R” be an open set 
and let J C R be an interval. Then we express that the n-dimensional 
vector field is defined on this domain as follows: 


f:UxI-R’, 
(a,t) > f(a,t) (1.14) 


We need a definition to describe the “regularity” of the vector field. 


Definition 7 (C” function). We say that f(z,t) isC”’ onUxICR”"xR 
if it is r times differentiable and each derivative is a continuous function 
(on the same domain). If r= 0, f(x,t) is just said to be continuous. 


2J. K. Hale. Ordinary Differential Equations. Dover, 2009; P. Hartman. Ordinary 
Differential Equations. Society for industrial and Applied Mathematics, 2002; E. A. 
Coddington and N. Levinson. Theory of Ordinary Differential Equations. Krieger, 
1984. 

3The “Existence and Uniqueness Theorem” is, traditionally, a standard part of ODE 
courses beyond the elementary level. This theorem, whose proof can be found in numer- 
ous texts (including those mentioned in the Preface), will not be given in this course. 
There are several reasons for this. One is that it requires considerable time to construct 
a detailed and careful proof, and I do not feel that this is the best use of time in a 12 week 
course. The other reason (not unrelated to the first) is that I do not feel that the under- 
standing of the detailed “Existence and Uniqueness” proof is particularly important at 
this stage of the students education. The subject has grown so much in the last forty 
years, especially with the merging of the “dynamical systems point of view” with the 
subject of ODEs, that there is just not enough time to devote to all the topics that 
students “should know”. However, it is important to know what it means for an ODE 
to have a solution, what uniqueness of solutions means, and general conditions for when 
an ODE has unique solutions. 
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Now we can state sufficient conditions for (1.13) to have a unique 
solution. We suppose that f(z,t) is C", r > 1. We choose any point 
(ao,to) € U x I. Then there exists a unique solution of (1.13) satisfying 
this initial condition. We denote this solution by a(t,to,xo), and reflect 
in the notation that it satisfies the initial condition by 2(to,to,20) = Zo. 
This unique solution exists for a time interval centered at the initial time 
to, denoted by (to — €, to + €), for some € > 0. Moreover, this solution, 
x(t, to, 20), is a C” function of t, to, xo. Note that from Example 4 € may 
depend on ao. This also explains how a solution “fails to exist” — it 
becomes unbounded (“blow up”) in a finite time. 

Finally, we remark that existence and uniqueness of ODEs is the math- 
ematical manifestation of determinism. If the initial condition is specified 
(with 100% accuracy), then the past and the future are uniquely deter- 
mined. The key phrase here is “100% accuracy”. Numbers cannot be spec- 
ified with 100% accuracy. There will always be some imprecision in the 
specification of the initial condition. Chaotic dynamical systems are deter- 
ministic dynamical systems having the property that imprecisions in the 
initial conditions may be magnified by the dynamical evolution, leading to 
seemingly random behavior (even though the system is completely deter- 
ministic). 


Problem Set 1 


1. For each of the ODEs below, write it as a first order system, state the 
dependent and independent variables, state any parameters in the ODE 
(i.e. unspecified constants) and state whether it is linear or nonlinear, 
and autonomous or nonautonomous, 


6+66+sin0=Fcosut, 0€S!. 


6+60+0=Fcoswt, 6¢€S'. 


#+d¢+a2—-—2° =8, 
6+sind=0, (2,0)e€R'xS!. 
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6+ 66+sin0 =z, 
#-a2+a°=0, (6,2)¢S'xR!. 
2. Consider the vector field: 
¢=323, 2(0)40, reER. 


Does this vector field have unique solutions?* 
3. Consider the vector field: 


g=—-2+2", 2(0)=2%, reER. 


Determine the time interval of existence of all solutions as a function 
of the initial condition, x9.° 


4. Consider the vector field: 
t=a(t)e+b(t), ceER. 


Determine sufficient conditions on the coefficients a(t) and b(t) for 
which the solutions will exist for all time. Do the results depend on 
the initial condition?® 

5. Consider the following two ODEs: 


d 1 
= are ee (1.15) 
dx xz 

and 
C= 2, 
y= —-y+s’. (1.16) 


4Note the similarity of this exercise to Example 3. The point of this exercise is to think 
about how issues of existence and uniqueness depend on the initial condition. 

5Here is the point of this exercise: 4 = —a has solutions that exist for all time (for any 
initial condition), « = x? has solutions that “blow up in finite time”. What happens 
when you “put these two together”? In order to answer this you will need to solve for 
the solution, x(t, xo). 

6The “best” existence and uniqueness theorems are when you can analytically solve 
for the “exact” solution of an ODE for arbitrary initial conditions. This is the type of 
ODE where that can be done. It is a first order, linear inhomogeneous ODE that can 
be solved using an “integrating factor” (see Appendix B for help with this). However, 
you will need to argue that the integrals obtained from this procedure “make sense”. 


12 Ordinary Differential Equations: A Dynamical Point of View 


and 


(a) For each ODE state the dependent variable, the independent vari- 
able and whether it is linear or nonlinear, autonomous or nonau- 
tonomous. 

(b) Find the explicit solutions of each ODE for a general initial condi- 
tion. (Hint: using the techniques in Appendix B may be helpful.) 

(c) Describe in what sense these two ODEs are “the same”. 


6. Recall the definition of second order linear ODE given in this chapter 
(see also Appendix C): 


d’s 


maz = (ao + ai(t))s + (bo + bi(t))8 + co + c(t), (1.17) 


where ao, bo, co are constants, and a(t), bi(t), e1(¢) are functions of t. 
First, consider the situation where cp = ci (t) = 0, ie. 


d’s 


m—; = (ao + ai(t))s + (bo + bi(t))s. (1.18) 


In this case the linear ODE is said to be homogeneous. 


(a) Suppose s,(t) is a solution of (1.18), and let k, denote a 
constant (real number). Prove that k1s51(t) is also a solution of 
(1.18). 

(b) Suppose s;(¢) and s2(t) are solutions of (1.18), and let ky and 
ka denote constants (real numbers). Prove that k1s1(t) + k252(t) 
is also a solution of (1.18). This is the superposition principle for 
linear homogeneous ODE?’s. 

(c) Do these two results hold for (1.17)? 


7. Are the following second order ODEs linear or nonlinear? 


(a) mS = —s+ cost, 
(b) ms = —s? + cost, 
(c) ms = —scost, 
(d) ms = —t?s, 

(e) m§ =—s+s8?, 


8. Consider the following ODE: 
t=ax, x«x(0)=20, 


where 7, a € R. 


10. 


al 


12. 


13. 
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(a) Show how to compute the solution of this ODE. 

(b) In chapter we have considered “uniqueness of solutions of ODEs”, 
as well as the fact that ODEs have “many” solutions. Explain these 
two (seemingly) contradictory statements in the context of this 
example. 


Consider the following ODE: 


As we showed in this chapter, this is an example of an ODE where 
solutions may exist only for a finite time interval. But are there any 
solutions that exist “for all time”, i.e. for an infinite time interval? 
Solve the following ODE: 


where g is a constant. 
Solve the following ODE: 


ms=sint, s(0)=59, §8(0) =0. 
Consider the following ODE: 
2 


Ms =s—s*. 


Find the function of s and § that a solution of this ODE must satisfy 
(hint: Appendix C will be helpful). 
Consider Newton’s equations: 


Define a new time variable, 7, which is related to the “old” time t by: 


t= Vm. 


Use the chain rule to show that with respect to the new time the ODE 
becomes: 


i.e. the constant disappears. This is referred to as rescaling time. 
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14. Consider the following nonlinear ODE: 


§=s—s?. 


Suppose s1(t) and s(t) are solutions, and let k; and kg denote con- 
stants.” 


(a) Is k1s1(t) a solution? 
(b) Is ky s1(t) + kos (t) a solution? 


‘This exercise shows that nonlinear ODEs do not (generally) obey a superposition 
principle. 


Chapter 2 


Special Structure and 
Solutions of ODEs 


A CONSISTENT THEME THROUGHOUT ALL OF ODES IS THAT “SPECIAL 
STRUCTURE” OF THE equations CAN REVEAL INSIGHT INTO THE NATURE 
OF THE solutions. Here we look at a very basic and important property of 
autonomous equations: 


“Time shifts of solutions of autonomous ODEs are also solu- 
tions of the ODE (but with a different initial condition)”. 


Now we will show how to see this. 


‘THROUGHOUT THIS COURSE WE WILL ASSUME THAT EXISTENCE AND 
UNIQUENESS OF SOLUTIONS HOLD ON A DOMAIN AND TIME INTERVAL 
SUFFICIENT FOR OUR ARGUMENTS AND CALCULATIONS. 

We start by establishing the setting. We consider an autonomous vector 
field defined on R”: 


z= f(x), 2(0)=2%, «cER", (2.1) 
with solution denoted by: 
x(t,0,29), 2(0,0,20) = 20. 


Here we are taking the initial time to be to = 0. We will see, shortly, 
that for autonomous equations this can be done without loss of generality. 
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Now we choose s € R (s £0, which is to be regarded as a fixed constant). 
We must show the following: 


#(t +s) = f(a(t +s)) (2.2) 


This is what we mean by the phrase time shifts of solutions are solutions. 
This relation follows immediately from the chain rule calculation: 


a ae 
dea eee eo) 


Finally, we need to determine the initial condition for the time shifted 
solution. For the original solution we have: 


x(t,0,20), 2(0,0,20) = 20, (2.4) 
and for the time shifted solution we have: 
u(t+s,0,20), «(s,0,20). (2.5) 


It is for this reason that, without loss of generality, for autonomous vector 
fields we can take the initial time to be tg = 0. This allows us to simplify 
the arguments in the notation for solutions of autonomous vector fields, i.e. 
x(t,0, 20) = x(t, 20) with «(0,0, 29) = x(0, 20) = 20. 


Example 5 (An example illustrating the time-shift property of 
autonomous vector fields). Consider the following one-dimensional 
autonomous vector field: 


t=rAx, «(0)=2%, LER, AER. (2.6) 


The solution is given by: 


x(t, 0,29) = x(t, 29) = e** ap. (2.7) 
The time shifted solution is given by: 
a(t + 8,9) = +9) x9. (2.8) 


We see that it is a solution of the ODE with the following calculations: 


“a(t + 8,29) = Ae**+9) ¢9 = da(t + 5, 20), (2.9) 


Special Structure and Solutions of ODEs 17 


with initial condition: 
(8,2) = e** zo. (2.10) 


In summary, we see that the solutions of autonomous vector fields satisfy 
the following three properties: 


1. x(0, 20) = Xo 
2. x(t, x9) is C” in x 
3. a(t + 8, x9) = a(t, x(s, x0)). 


Property one just reflects the notation we have adopted. Property 2 is a 
statement of the properties arising from existence and uniqueness of solu- 
tions. Property 3 uses two characteristics of solutions. One is the “time 
shift” property for autonomous vector fields that we have proven. The other 
is “uniquess of solutions” since the left-hand side and the right-hand side 
of Property 3 satisfy the same initial condition at t = 0. 

These three properties are the defining properties of a flow, i.e. a one- 
parameter group of transformations of the phase space. In other words, 
we view the solutions as defining a map of points in phase space. The 
group property arises from property 3, i.e. the time-shift property. In order 
to emphasize this “map of phase space” property we introduce a general 
notation for the flow as follows: 


x(t, x20) = d:(-), 


where the in the argument of ¢;(-) reflects the fact that the flow is a 
function on the phase space. With this notation the three properties of a 
flow are written as follows: 


6699 


1. do(-) is the identity map 
2. $1(-) is C” for each t 
3. dt+s(-) = bo dbs(-). 


We often use the phrase “the flow generated by the (autonomous) vector 
field”. Autonomous is in parentheses as it is understood that when we are 
considering flows then we are considering the solutions of autonomous vec- 
tor fields. This is because nonautonomous vector fields do not necessarily 
satisfy the time-shift property, as we now show with an example. 


Example 6 (An example of a nonautonomous vector field not hav- 
ing the time-shift property). Consider the following one-dimensional 
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vector field on R: 
t=Ate, «(0)=20, ER, AER. 
This vector field is separable and the solution is easily found to be: 
x(t, 0,20) = ape?” 
The time shifted “solution” is given by: 


x(t + s,0,20) = ape2 tts)”, 


We show that this does not satisfy the vector field with the following 
calculation: 


aut + 8,0,%9) = ae? +8)” \(¢ +s). 
# Atx(t + 5,0, 20). 


Perhaps a more simple example illustrating that nonautonomous vector 
fields do not satisfy the time-shift property is the following. 


Example 7. Consider the following one-dimensional nonautonomous vec- 
tor field: 


The solution is given by: 
z(t) =e’. 
It is easy to verify that the time-shifted function: 
e+ a) =e, 
does not satisfy the equation. 


In the study of ODEs certain types of solutions have achieved a level of 
prominence largely based on their significance in applications. They are 


e equilibrium solutions, 
e periodic solutions, 

e heteroclinic solutions, 
e homoclinic solutions. 


We define each of these. 
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Definition 8 (Equilibrium). A point in phase space x = £ = R” that is 
a solution of the ODE, i.e. 


f(z) =0, f(z,t) =0, 
is called an equilibrium point. These may also be referred to as fixed points. 


For example, x = 0 is an equilibrium point for the following autonomous 
and nonautonomous one-dimensional vector fields, respectively, 


t=a2, «ER, 


t=tr, «teER. 


A periodic solution is simply a solution that is periodic in time. Its 
definition is the same for both autonomous and nonautonomous vector 
fields. 


Definition 9 (Periodic solutions). A solution x(t, to,20) is periodic if 
there exists a T’ > 0 such that 


x(t, to, Zo) = x(t T, qT, to, £0). 


Homoclinic and heteroclinic solutions are important in a variety of 
applications. Their definition is not so simple as the definitions of equi- 
librium and periodic solutions since they can be defined and generalized 
to many different settings. We will only consider these special solutions 
for autonomous vector fields, and solutions homoclinic or heteroclinic to 
equilibrium solutions. 


Definition 10 (Homoclinic and Heteroclinic Solutions). Suppose %1 
and Z2 are equilibrium points of an autonomous vector field, i.e. 


A trajectory x(t, to, 2) is said to be heteroclinic to %1 and Z2 if 


jim u(t, to, %0) = Za, 
—_ (2.11) 


Jim x(t, to, Xo) = 71. 


If Z, = £2 the trajectory is said to be homoclinic to Z, = Zo. 
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Example 8.' Here we give an example illustrating equilibrium points and 
heteroclinic orbits. Consider the following one-dimensional autonomous 
vector field on R: 


g£=2-2°=c(1-27), ceER. (2.12) 


This vector field has three equilibrium points at « = 0, +1. 

In Fig. 2.1 we show the graph of the vector field (2.12) in panel (a) and 
the phase line dynamics in panel (b). 

The solid black dots in panel (b) correspond to the equilibrium points 
and these, in turn, correspond to the zeros of the vector field shown in 
panel (a). Between its zeros, the vector field has a fixed sign (i.e. positive 
or negative), corresponding to « being either increasing or decreasing. This 
is indicated by the direction of the arrows in panel (b). 


Fig. 2.1. (a) Graph of the vector field. (b) The phase space. 


1 There is a question that we will return to throughout this course. What does it mean 
to “solve” an ODE? We would argue that a more “practical” question might be, “what 
does it mean to understand the nature of all possible solutions of an ODE?”. But don’t 
you need to be able to answer the first question before you can answer the second? We 
would argue that Fig. 2.1 gives a complete “qualitative” understanding of (2.12) in a 
manner that is much simpler than one could directly obtain from its solutions. In fact, 
it would be an instructive exercise to first solve (2.12) and from the solutions sketch 
as in Fig. 2.1. This may seem a bit confusing, but it is even more instructive to think 
about, and understand, what it means. 
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Our discussion about trajectories, as well as this example, brings us 
to a point where it is natural to introduce the important notion of an 
invariant set. While this is a general idea that applies to both autonomous 
and nonautonomous systems, in this course we will only discuss this notion 
in the context of autonomous systems. Accordingly, let ¢;(-) denote the 
flow generated by an autonomous vector field. 


Definition 11 (Invariant Set). A set MC R” is said to be invariant if 
creEeM>¢(r)EeM Vt. 


In other words, a set is invariant (with respect to a flow) if you start in 
the set, and remain in the set, forever. 

If you think about it, it should be clear that invariant sets are sets 
of trajectories. Any single trajectory is an invariant set. The entire phase 
space is an invariant set. The most interesting cases are those “in between”. 
Also, it should be clear that the union of any two invariant sets is also an 
invariant set (just apply the definition of invariant set to the union of two, 
or more, invariant sets). 

There are certain situations where we will be interested in sets that are 
invariant only for positive time-positive invariant sets. 


Definition 12 (Positive Invariant Set). A set M C R” is said to be 
positive invariant if 


ceEMs¢(r)eM Vt>O0. 


There is a similar notion of negative invariant sets, but the generalization 
of this from the definition of positive invariant sets should be obvious, so 
we will not write out the details. 

Concerning Example 8, the three equilibrium points are invariant sets, 
as well as the closed intervals [—1,0] and [0,1]. Are there other invariant 
sets? 


Problem Set 2 
1. Consider the following ODE: 


where x, aE R. 
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(a) Show how to how compute the solution of this ODE. 

(b) Show that if you shift the time of the solution of this ODE, i.e. let 
t— t+, for some fixed s, then the result is still a solution of the 
ODE. 

(c) How does the initial condition of the ODE, i.e. the value of the 
solution at t = 0, compare to the initial condition of the solution 
of the ODE without the time shift? 


Consider an autonomous vector field on the plane having an equilib- 
rium point with a homoclinic orbit connecting the equilibrium point, 
as illustrated in Fig. 2.2. We assume that existence and uniqueness of 
solutions hold. Can a trajectory starting at any point on the homo- 
clinic orbit reach the equilibrium point in a finite time? (You must 
justify your answer.)? 


Fig. 2.2. Homoclinic orbit connecting an equilibrium point. 


3. Can an autonomous vector field on R that has no equilibrium points 


have periodic orbits? We assume that existence and uniqueness of solu- 
tions hold. (You must justify your answer.)? 


2The main points to take into account for this problem are the fact that two trajectories 
cannot cross (in a finite time), and that an equilibrium point is a trajectory. 

3The main points to take into account in this problem is that the phase space is R and 
using this with the implication that trajectories of autonomous ODEs “cannot cross”. 
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4. Can a nonautonomous vector field on R that has no equilibrium points 
have periodic orbits? We assume that existence and uniqueness of solu- 
tions hold. (You must justify your answer.)4 

5. Can an autonomous vector field on the circle that has no equilibrium 
points have periodic orbits? We assume that existence and uniqueness 
of solutions hold. (You must justify your answer.)° 


6. Consider the following autonomous vector field on the plane: 


x Wy, 
y = WE, (a, y) Sc R?, 
where w > 0. 


e Show that the flow generated by this vector field is given by®: 


eS coswt —sinwt (*") 
y(t)/  \sinwt  coswt} \ yo’ 
e Show that the flow obeys the time shift property. 
e Give the initial condition for the time shifted flow. 
7. Consider the following autonomous vector field on the plane: 
& = ry, 
y=Ax, (a,y) ER’, 
where \ > 0. 


e Show that the flow generated by this vector field is given by: 


& ) 7 cosh At sinh At (* ) 
y(t)) ~— \ sinhAt coshXt yo J 
e Show that the flow obeys the time shift property. 

e Give the initial condition for the time shifted flow. 


4It is probably easiest to answer this problem by constructing a specific example. 

5The main point to take into account here is that the phase space is “periodic”. 

®Recall that the flow is obtained from the solution of the ODE for an arbitrary initial 
condition. 
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Show that the time shift property for autonomous vector fields implies 
that trajectories cannot “cross each other”, i.e. intersect, in phase 
space. 

Show that the union of two invariant sets is an invariant set. 

Show that the intersection of two invariant sets is an invariant set. 
Show that the complement of a positive invariant set is a negative 
invariant set. 


Chapter 3 


Behavior Near Trajectories 
and Invariant Sets: Stability 


Consider the general nonautonomous vector field in n dimensions: 
&=f(#,t), ceR", (3.1) 


and let Z(t, to,vo) be a solution of this vector field. 


MANY QUESTIONS IN ODES CONCERN UNDERSTANDING THE BEHAVIOR 
OF NEIGHBORING SOLUTIONS NEAR A GIVEN, CHOSEN SOLUTION. We will 
develop the general framework for considering such questions by transform- 
ing (3.1) to a form that allows us to explicitly consider these issues. 

We consider the following (time dependent) transformation of variables: 


x=yt Z(t, to, xo). (3.2) 


We wish to express (3.1) in terms of the y variables. It is important to 
understand what this will mean in terms of (3.2). For y small it means that 
x is near the solution of interest, Z(t, to, zo). In other words, expressing the 
vector field in terms of y will provide us with an explicit form of the vector 
field for studying the behavior near Z(t, to, 20). Towards this end, we begin 
by transforming (3.1) using (3.2) as follows: 


£=y+2= f(x,t) = f(y+2,d), (3.3) 
or, 
g=flyt+2,t) —2, 
=fly Tv z,t) — f(z,t) = gly, t), g(0,t) = 0. (3.4) 
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Hence, we have shown that solutions of (3.1) near Z(t, to, vo) are equivalent 
to solutions of (3.4) near y = 0. 

The first question we want to ask related to the behavior near Z(E, to, 20) 
is whether or not this solution is stable? However, first we need to mathe- 
matically define what is meant by this term “stable”. Now we should know 
that, without loss of generality, we can discuss this question in terms of the 
zero solution of (3.4). 

We begin by defining the notion of “Lyapunov stability” (or just 
“stability” ). 


Definition 13 (Lyapunov Stability). y = 0 is said to be Lyapunov 
stable at to if given € > 0 there exists a 6 = 0(to,€) such that 


ly(to)| <6 => |y(t)|<e, Vt > to (3.5) 
If a solution is not Lyapunov stable, then it is said to be unstable. 


Definition 14 (Unstable). If y = 0 is not Lyapunov stable, then it is 
said to be unstable. 


Then we have the notion of asymptotic stability. 


Definition 15 (Asymptotic stability). y = 0 is said to be asymptoti- 
cally stable at to if: 


1. it is Lyapunov stable at to, 
2. there exists 6 = d(to) > 0 such that: 


Iu(to)| <6 = lim |y(#)| =0. (3.6) 
We have several comments about these definitions. 


e Roughly speaking, a Lyapunov stable solution means that if you start 
close to that solution, you stay close — forever. Asymptotic stability 
not only means that you start close and stay close forever, but that you 
actually get “closer and closer” to the solution. 

e Stability is an infinite time concept. 

e If the ODE is autonomous, then the quantity 6 = d(to,€) can be chosen 
to be independent of to. 

e The definitions of stability do not tell us how to prove that a solution 
is stable (or unstable). We will learn two techniques for analyzing this 
question — linearization and Lyapunov’s (second) method. 
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e Why is Lyapunov stability included in the definition of asymptotic stabil- 
ity? Because it is possible to construct examples where nearby solutions 
do get closer and closer to the given solution as t + oo, but in the pro- 
cess there are intermediate intervals of time where nearby solutions make 
“large excursions” away from the given solution. 


“Stability” is a notion that applies to a “neighborhood” of a trajectory.! 
At this point we want to formalize various notions related to distance and 
neighborhoods in phase space. For simplicity in expressing these ideas we 
will take as our phase space R”. Points in this phase space are denoted 
x €R", « = (a1,...,@,). The norm, or length, of x, denoted || is defined 
as: 


n 
= fe 2 . 2 _ 2 
jal = fap +ag+e- +22 = S wy - 
i=1 


The distance between two points in x,y € R” is defined as: 


A2,.0) = |p — yl = 4/ Si — bP ee en = te) 


Distance between points in R” should be somewhat familiar, but now we 
introduce a new concept, the distance between a point and a set. Consider 
aset M, M CR”, let p € R”. Then the distance from p to M is defined 
as follows: 


dist(p, M) = infzem|p — 2. (3.8) 


We remark that it follows from the definition that if p € M, then 
dist(p, M) = 0. 

We have previously defined the notion of an invariant set. Roughly 
speaking, invariant sets are comprised of trajectories. We now have the 
background to discuss the notion of stability of invariant sets. Recall, that 


1The notion that stability of a trajectory is a property of solutions in a neighborhood of 
a trajectory often causes confusion. To avoid confusion it is important to be clear about 
the notion of a “neighborhood of a trajectory”, and then to realize that for solutions 
that are Lyapunov (or asymptotically) stable all solutions in the neighborhood have the 
same behavior as t > oo. 
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the notion of invariant set was only developed for autonomous vector fields. 
So we consider an autonomous vector field: 


t=f(x), ceER", (3.9) 


and denote the flow generated by this vector field by ¢;(-). Let M be a 
closed invariant set (in many applications we may also require M to be 
bounded) and let U > M denoted a neighborhood of M. 

The definition of Lyapunov stability of an invariant set is as follows: 


Definition 16 (Lyapunov Stability of M). lM is said to be Lyapunov 
stable if for any neighborhood U 5 M, « € U => ¢;(«) € U, Vt > 0. 


Similarly, we have the following definition of asymptotic stability of an 
invariant set. 


Definition 17 (Asymptotic Stability of M). M is said to be asymp- 
totically stable if 


1. it is Lyapunov stable, 
2. there exists a neighborhood U D M such that Vz € U, dist(¢: (a), M) > 
Oast — oo. 


In the dynamical systems approach to ordinary differential equations 
some alternative terminology is typically used. 


Definition 18 (Attracting Set). If M is asymptotically stable it is said 
to be an attracting set. 


The significance of attracting sets is that they are the “observable” regions 
in phase space since they are regions to which trajectories evolve in time. 
The set of points that evolve towards a specific attracting set is referred to 
as the basin of attraction for that invariant set. 


Definition 19 (Basin of Attraction). Let B C R” denote the set of all 
points, c € B C R” such that 


dist(¢:(x), M) 30 ast oo. 


Then B is called the basin of attraction of /. 
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We now consider an example that allows us to explicitly explore these 
ideas.” 


Example 9. Consider the following autonomous vector field on the plane: 


L=-2, 


yU-y =f), wy)eR’. (3.10) 


y 


First, it is useful to note that the x and y components of (3.10) are inde- 
pendent. Consequently, this may seem like a trivial example. However, 
we will see that such examples provide a great deal of insight, especially 
since they allow for simple computations of many of the mathematical 
ideas. 

In Fig. 3.1 we illustrate the flow of the « and y components of (3.10) 
separately. 

The two-dimensional vector field (3.10) has equilibrium points at: 


(x,y) = (0, 0), (0,1), (0;=1). 


In this example it is easy to identify three invariant horizontal lines (exam- 
ples of invariant sets). Since y = 0 implies that y = 0, this implies that the 
x-axis is invariant. Since y = 1 implies that y = 0, this implies that the line 
y = 1 is invariant. Since y = —1 implies that y = 0, which implies that the 
line y = —1 is invariant. This is illustrated in Fig. 3.2.2 Below we provide 
some additional invariant sets for (3.10). It is instructive to understand 


*Initially, this type of problem (two independent, one-dimensional autonomous vector 
fields) might seem trivial and like a completely academic problem. However, we believe 
that there is quite a lot of insight that can be gained from such problems (that has been 
the case for the author). Generally, it is useful to think about breaking a problem up 
into smaller, understandable, pieces and then putting the pieces back together. Problems 
like this provide a controlled way of doing this. But also, these problems allow for exact 
computation by hand of concepts that do not lend themselves to such computations in 
the types of ODEs arising in typical applications. This gives some level of confidence 
that you understand the concept. Also, such examples could serve as useful benchmarks 
for numerical computations, since checking numerical methods against equations where 
you have an analytical solution to the equation can be very helpful. 

3Make sure you understand why these constraints on the coordinates imply the exis- 
tence of invariant lines. 
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> ° < x 


<_-~_>->_-_<« y 


Fig. 3.1. (a) The phase “line” of the x component of (3.10). (b) The graph of f(y) 
(top) and the phase “line” of the y component of (3.10) directly below. 


Fig. 3.2. Phase plane of (3.10). The black dots indicate equilibrium points. 
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why they are invariant, and whether or not there are other invariant sets. 

Additional invariant sets for (3.10). 

{(z,y)] -coo<u<0,-co<y<-l}, 
0<a<ow,-wo<y<-—l}, 
—o<«<0,-l<y< 9}, 
0<a<o,-l<y< 0}, 


0<a<w,0<y< Ih, 


—-o<2£<0,1<y< of, 


( 

{(x,y) 

{(x,y) 

{(x,y) 

{(z,y)] -wo <a4<0,0<y< Il}, 
{(x,y) 

{(x,y) 

{(x,y) 


0<a<w,l<y< ob}, 


Problem Set 3 
1. Consider the following autonomous vector field on R: 
g=a2-2°, ceR. abe 


e Compute all equilibria and determine their stability, i.e. are they 
Lyapunov stable, asymptotically stable, or unstable? 

e Compute the flow generated by (3.11) and verify the stability results 
for the equilibria directly from the flow. 


2. Consider the following three autonomous ODEs on R: 
L=-£, C=-2L, C= -2. 


x = 0 is an equilibrium point for each vector field. For each vector field 
explain if z = 0 is Lyapunov stable, unstable, or asymptotically stable. 
3. Consider the following autonomous vector field on R: 


C2; 
Determine all of the equilibria for this vector field and discuss their 
stability. 

4. Consider the following autonomous vector field on R: 

oS. 
Is the closed unit interval, i.e. [0,1], and invariant set for this vec- 
tor field? If so, discuss its stability. Does this vector field have other 
invariant sets? 
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Consider the following autonomous ODE on R, 


t=-. 
x 


Sketch the direction of the vector field on R and determine all equilibria 
and characterize their stability. 
Consider an autonomous vector field on R"*: 


&= f(x), «2 €R”. (3.12) 


Suppose M c R” is a bounded, invariant set for (3.12). Let ¢:(-) 
denote the flow generated by (3.12). Suppose p € R”, p ¢ M. Is it 
possible for 


(Pp) € M, 


for some finite t? 
Consider the following vector field on the plane: 


g=a2-2°, 


y= -y, (x,y) ER’. (3.13) 


(a) Determine zero-dimensional, one-dimensional, and two-dimensional 
invariant sets. 

b) Determine the attracting sets and their basins of attraction. 

( g 

c) Describe the heteroclinic orbits and compute analytical expressions 

y 

for the heteroclinic orbits. 

(d) Does the vector field have periodic orbits?° 

(e) Sketch the phase portrait.® 


Consider the following three one-dimensional autonomous vector fields: 


(a) 6=sind, 
(b) 6=1+sind, 
(c) 0=2+sin0, 


4This problem is “essentially the same” as Problem 1 from Problem Set 2. 


5Keep in mind here that a trajectory is periodic if it is periodic, with the same period, 
in each component. 

®There is a point to consider early on in this course. What exactly does “sketch the 
phase portrait mean”? It means sketching trajectories through different initial condi- 
tions in the phase space in such a way that a “complete picture” of all qualitatively 
distinct trajectories is obtained. The phrase qualitatively distinct is the key here since 
you can only sketch trajectories for a finite number of initial conditions (unless you 
sketch an invariant set or manifold) and only a finite length of the trajectory, unless the 
trajectory is a fixed point, periodic, homoclinic, or heteroclinic. 


10. 
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where @ is an angular variable. We consider these vector fields defined 
on 


—m7<@<7, mod2z, 


and mod 27 means that angles that differ by integer multiples of 27 are 
considered as the same value. 


(a) Calculate the equilibria of these vector fields and sketch the phase 
portraits. 
(b) Do any of these vector fields have periodic orbits? 


Consider the following ODE: 
ES 4/2. 


where x is a real number. 


(a) What is the phase space of this ODE? 

(b) What are the equilibrium points of this ODE? 

(c) Sketch the equilibrium points and indicate their stability in the 
phase space of this ODE. 


Consider the following two-dimensional linear autonomous ODE on R?, 
z= y, 
y= a. 
Consider the transformation from cartesian to polar coordinates defined 
by « = rcos@, y = rsin@. Express this ODE in polar coordinates in 
the form of 7 and @ and show that the trajectories of the ODE in polar 


coordinates are circles. From this argue that the origin is Lyapunov 
stable. 
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Chapter 4 


Behavior Near Trajectories: 
Linearization 


NOW WE ARE GOING TO DISCUSS A METHOD FOR ANALYZING STABILITY 
THAT UTILIZES LINEARIZATION ABOUT THE OBJECT WHOSE STABILITY IS 
OF INTEREST. For now, the “objects of interest” are specific solutions of 
a vector field. The structure of the solutions of linear, constant coefficient 
systems is covered in many ODE textbooks. My favorite is the book by 
Hirsch et al.‘ It covers all of the linear algebra needed for analyzing linear 
ODEs that you probably did not cover in your linear algebra course. The 
book by Arnold? is also very good, but the presentation is more compact, 
with fewer examples. 
We begin by considering a general nonautonomous vector field: 


&=f(#,t), «ceR", (4.1) 
and we suppose that 
Z(t, to, Xo), (4.2) 


is the solution of (4.1) for which we wish to determine its stability prop- 
erties. As when we introduced the definitions of stability, we proceed by 
localizing the vector field about the solution of interest. We do this by 


1M. W. Hirsch, S. Smale, and R. L. Devaney. Differential Equations, Dynamical Sys- 
tems, and an Introduction to Chaos. Academic Press, 2012. 

2V.1. Arnold. Ordinary Differential Equations. M.1.T. Press, Cambridge, 1973. ISBN 
0262010372. 
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introducing the change of coordinates 


for (4.1) as follows: 


or 


= fy IP mt) = fie.) (4.3) 


where we omit the arguments of Z(t, to, zo) for the sake of a less cumbersome 
notation. Next we Taylor expand f(y+%,t) in y about the solution %, but 
we will only require the leading order terms explicitly?: 


Fly +, t) = f(&,t) + Df(&, thy + O(lyl’), (4.4) 


where Df denotes the derivative (i.e. Jacobian matrix) of the vector valued 
function f and O(|y|?) denotes higher order terms in the Taylor expansion 
that we will not need in explicit form. Substituting this into (4.4) gives: 


= f(G,t) + Df(@, thy + Oly’) — f@9, 

= Df(z,t)y + O(\yl?). (4.5) 
Keep in mind that we are interested in the behavior of solutions near 
Z(t, to, xo), ie. for y small. Therefore, in that situation it seems reason- 
able that neglecting the O(|y|?) in (4.5) would be an approximation that 
would provide us with the particular information that we seek. For exam- 


ple, would it provide sufficient information for us to determine stability? 
In particular, 


y = Df(z, thy, (4.6) 


is referred to as the linearization of the vector field « = f(x,t) about the 
solution Z(t, to, Zo). 


3For the necessary background that you will need on Taylor expansions see Appendix A. 
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Before we answer the question as to whether or not (4.1) provides an 
adequate approximation to solutions of (4.5) for y “small”, we will first 
study linear vector fields on their own. 

Linear vector fields can also be classified as nonautonomous or 
autonomous. Nonautonomous linear vector fields are obtained by lineariz- 
ing a nonautonomous vector field about a solution (and retaining only the 
linear terms). They have the general form: 


y=A(t)y, y(0) =yo, (4.7) 
where 
A(t) = Df (Z(t, to, x0), t) (4.8) 


isamxn matrix. They can also be obtained by linearizing an autonomous 
vector field about a time-dependent solution. 

An autonomous linear vector field is obtained by linearizing an 
autonomous vector field about an equilibrium point. More precisely, let 
& = f(x) denote an autonomous vector field and let x = a denote an 
equilibrium point, i.e. f(a) = 0. The linearized autonomous vector field 
about this equilibrium point has the form: 


y=Df(xo)y, y(0) = yo, (4.9) 


or 


where A = Df(xo) is an xX n matrix of real numbers. This is significant 
because (4.10) can be solved using techniques of linear algebra, but (4.7), 
generally, cannot be solved in this manner. Hence, we will now describe 
the general solution of (4.10). 

The general solution of (4.10) is given by: 


y(t) = e**yo. (4.11) 


In order to verify that this is the solution, we merely need to substitute into 
the right-hand side and the left-hand side of (4.10) and show that equality 
holds. However, first we need to explain what e“ is, ie. the exponential 
of the n x n matrix A (by examining (4.11) it should be clear that if (4.11) 
is to make sense mathematically, then e“’ must be a n x n matrix). 
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Just like the exponential of a scalar, the exponential of a matrix is 
defined through the exponential series as follows: 


1 1 
e S14 Ae AP be Ae, 
2! n! 
= 3 1 yigi (4.12) 
Sei? 


where I denotes the n x n identity matrix. But we still must answer the 
question, “does this exponential series involving products of matrices make 
mathematical sense”? Certainly we can compute products of matrices and 
multiply them by scalars. But we have to give meaning to an infinite sum 
of such mathematical objects. We do this by defining the norm of a matrix 
and then considering the convergence of the series in norm. When this is 
done the “convergence problem” is exactly the same as that of the expo- 
nential of a scalar. Therefore the exponential series for a matrix converges 
absolutely for all t, and therefore it can be differentiated with respect 
to t term-by-term, and the resulting series of derivatives also converges 
absolutely. 

Next we need to argue that (4.11) is a solution of (4.10). If we differ- 
entiate the series (4.12) term by term, we obtain that: 


d 
— At _ Ae“ _ e4t 4 


41 
“ 7 (4.13) 


where we have used the fact that the matrices A and e4 commute (this is 
easy to deduce from the fact that A commutes with any power of A).* It 
then follows from this calculation that: 


y= —e4* yo = Ae**yo = Ay. (4.14) 


Therefore the general problem of solving (4.10) is equivalent to computing 


e4t and we now turn our attention to this task. 


First, suppose that A is a diagonal matrix, say 


> O a G 
i Ae ws 0 
A= (4.15) 
0 0 -. 0 
O i as. 2. 


4See Appendix B for another derivation of the solution of (4.10). 
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Then it is easy to see by substituting A into the exponential series (4.12) 
that: 


et 0 
0 et ... 0 
eAt — ' (4.16) 
¢ @ “ 4 
0 0 ernt 


Therefore our strategy will be to transform coordinates so that in the new 

coordinates A becomes diagonal (or as “close as possible” to diagonal, which 

we will explain shortly). Then e“* will be easily computable in these coor- 

dinates. Once that is accomplished, then we use the inverse of the trans- 

formation to transform the solution back to the original coordinate system. 
Now we make these ideas precise. We let 


y=Tu, we R”, yER’, (4.17) 
where T is an xX n matrix whose precise properties will be developed in the 


following. 


THIS IS A TYPICAL APPROACH IN ODES. WE PROPOSE A GENERAL 
COORDINATE TRANSFORMATION OF THE ODE, AND THEN WE CONSTRUCT 
IT IN A WAY THAT GIVES THE PROPERTIES OF THE ODE THAT WE DESIRE. 
Substituting (4.17) into (4.10) gives: 


y= Tu= Ay = ATu, (4.18) 
T will be constructed in a way that makes it invertible, so that we have: 
a=T 'ATu, u(0) =T~*y(0). (4.19) 
To simplify the notation we let: 
A=P-TAT, (4.20) 
or 
A=TAT, (4.21) 
Substituting (4.21) into the series for the matrix exponential (4.12) gives: 
At _ prae t 


e€ 


1 1 é 
=1+TAT4+ 5 GATS Baad = (ENP panes 
(4.22) 
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Now note that for any positive integer n we have: 


(PAP = (PAE) (PAP) os (PAT) (TAT), 


n factors 
=T"T +, (4.23) 
Substituting this into (4.22) gives: 
ll 
At —1\" yn 
era) Gary 
n=0 
aT 3 Aare \ ro 
> n! , 
n=0 
=Te“T-I, (4.24) 
or 
tate tl, (4.25) 


Now we arrive at our main result. If T’ is constructed so that 
L=T Ar. (4.26) 


is diagonal, then it follows from (4.16) and (4.25) that e4* can always be 
computed. So the ODE problem of solving (4.10) becomes a problem in 
linear algebra. But can a general n x n matrix A always be diagonalized? 
If you have had a course in linear algebra, you know that the answer to 
this question is “no”. There is a theory of the (real) that will apply here. 
However, that would take us into too great a diversion for this course. 
Instead, we will consider the three standard cases for 2 x 2 matrices. That 
will suffice for introducing the main ideas without getting bogged down in 
linear algebra. Nevertheless, it cannot be avoided entirely. You will need 
to be able to compute eigenvalues and eigenvectors of 2 x 2 matrices, and 
understand their meaning. 

The three cases of 2 x 2 matrices that we will consider are characterized 
by their eigenvalues: 


e two real eigenvalues, diagonalizable A, 
e two identical eigenvalues, nondiagonalizable A, 
e a complex conjugate pair of eigenvalues. 
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In the table below we summarize the form that these matrices can be 
transformed to (referred to as that of A) and the resulting exponential of 
this canonical form. 


eigenvalues of A canonical form, A e' 
r 
A, p real, diagonalizable os [ ° 
0 pw Oe? 

A 1 0 1 e 0 
sty GC) CONEY 
nondiagonalizable OA oy oe 

on conjugate pair, & - ce i oe 


Once the transformation to A has been carried out, we will use these results 
A 


to deduce e*. 
Problem Set 4 
1. Suppose A is an X n matrix and T is a n X n invertible matrix. Use 
mathematical induction to show that: 


(TAT) =T-A*T, 


for all natural numbers k, i.e., k = 1,2,3,.... 

2. Suppose A is a n xX n matrix. Use the exponential series to give an 
argument that: 
dat At 
—e*" = Ae”. 
dt 

(You are allowed to use e4(4+”) = e4teA’ without proof, as well as the 
fact that A and e4* commute, without proof.) 

3. Consider the following linear autonomous vector field: 


t=Az, 2«(0)=20, cER", 


where A is an X n matrix of real numbers. 
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e Show that the solutions of this vector field exist for all time. 
e Show that the solutions are infinitely differentiable with respect to the 
initial condition, xo. 


See Footnote 5. 
4. Consider the following linear autonomous vector field on the plane: 


(3) = Es ("). (x1 (0), 22(0)) = (210,220). (4.27) 


(a) Describe the invariant sets. 
(b) Sketch the phase portrait. 
(c) Is the origin stable or unstable? Why? 


5. Consider the following linear autonomous vector field on the plane: 


(3) = € 5) (*:). (x1(0),x2(0)) = (210,220). (4.28) 


(a) Describe the invariant sets. 
(b) Sketch the phase portrait. 
(c) Is the origin stable or unstable? Why? 


6. Compute e4, where 


Hint. Write 


Then 


A=S+N, and NS=SN. 


5The next two problems often give students difficulties. There are no hard calculations 
involved. Just a bit of thinking. The solutions for each ODE can be obtained easily. 
Once these are obtained you just need to think about what they mean in terms of the 
concepts involved in the questions that you are asked, e.g. Lyapunov stability means 
that if you “start close, you stay close — forever”. 
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Use the binomial expansion fo compute (S + N)", n> 1, 


mp3 (2) st 


k=0 


where 


(aaa 


and substitute the results into the exponential series.® 
7. Let 
aa, ? > 
Boa 
Show that 


A q{ cos8 —sinB 
sin cos 


Hint: The eigenvalues of A are a+i3. Compute the complex eigenvec- 
tors for each eigenvalue. These should be 


&) 


and 


respectively. Form the transformation matrix T with these complex 
eigenvectors as the columns. Compute T~!. 
Then 


A=TAT"1, 
where 


a+ip 0 
0 a—ip 


A= 


8 N is an example of a nilpotent matrix. A square matrix is said to be nilpotent if N* 
is the zero matrix (i.e. a matrix all of whose entries are zero) for some positive integer k. 
The smallest such k is called the index of N or the degree of N. 
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Now since A is diagonal we have 


A e(atip) 0 ae eB 0 
= 0 ele?) = 0 eB] 


Now use Euler’s formula: 
e’? =cosB+isinB, e *® =cosf—isinB, 
and substitute this into the expression for e*. Finally, you can work out 
e4 = TAT". 
8. The equation for a damped and driven harmonic oscillator is given by: 
mebpoe he= f(t). 


where m, 7, k are positive and f(t) is a bounded continuous function. 
We want to first simplify the constants a bit. We divide through by m: 


k t 
pee Pe, 
m m m 


We then redefine certain of the constants: 


Wo = ie, 2¢wo = <, g(t) = - 


after which the equation becomes: 
£ + 2Cwot + wx = g(t), 
and this is the equation that this problem will be dealing with. 
(a) Show that this equation can be written in the form: 
u= Au+ h(t), 
where u € R? and A is a 2 x 2 matrix. 


What is the general form of the solutions of ODEs of this type? 
(Recall Appendix B.) 
(b) Compute the eigenvalues of A. 


Chapter 5 


Behavior Near Equilibria: 
Linearization 


Now we will consider several examples for solving, and understanding, the 
nature of the solutions, of 


t=Az, xeR’. ‘con 
For all of the examples, the method for solving the system is the same. 
Step 1. Compute the eigenvalues of A. 
Step 2. Compute the eigenvectors of A. 
Step 3. Use the eigenvectors of A to form the transformation matrix T. 


Step 4. Compute A = T-!AT. 
Step 5. Compute e4t = TeA‘T-!, 


Once we have computed e“* we have the solution of (5.1) through any 
=e 


initial condition 2 since x(t), x(0) = a9, is given by x(t) = e4*ag.! 


Example 10. We consider the following linear, autonomous ODE: 
Ly 2 1 Ly 
= a 
(3) é q (3): 62) 


Ae & a (5.3) 


Most of the linear algebra techniques necessary for this material is covered in 
Appendix A. 


where 
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Step 1. Compute the eigenvalues of A. 


The eigenvalues of A, denote by A, are given by the solutions of the char- 
acteristic polynomial: 


2-r 1 
det = (2-4)? -1=0, 
1 2=d 


= 7-4. 4+3=0, (5.4) 


or 


1 
Aig =24 gv 16 — 12=3,1. 
Step 2. Compute the eigenvectors of A. 


For each eigenvalue, we compute the corresponding eigenvector. The eigen- 
vector correponding to the eigenvalue 3 is found by solving: 


@ 2)(2)=#(3). 6 


221 +f = 321, (5.6) 


or, 


t+ 2x2 = 32%2. (5.7) 


Both of these equations yield the same equation since the two equations 
are dependent: 


2 = 71. (5.8) 


Therefore we take as the eigenvector corresponding to the eigenvalue 3: 


({): (5.9) 


Next we compute the eigenvector corresponding to the eigenvalue 1. 
This is given by a solution to the following equations: 


( 2)(2)-(2) 619 
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or 
20, +%2 = %1, (5.11) 
t+ 209 = 1. (5.12) 

Both of these equations yield the same equation: 
tq = —21. (5.13) 


Therefore we take as the eigenvector corresponding to the eigenvalue 1: 


ey (5.14) 


Step 3. Use the eigenvectors of A to form the transformation 
matrix T. 


For the columns of T we take the eigenvectors corresponding the the eigen- 


values 1 and 3: 
Me lk 
re(1), a 


T= ; € a) (5.16) 


Step 4. Compute A = T~" AT. 


1/1 -l 
| = 5 
T ar=3(7 1) ( 


with the inverse given by: 


We have: 


1 0 
= =A. 5.17 
(ica) (6.17) 
Therefore, in the ui — w2 coordinates (5.2) becomes: 
wy 1 0\ fu 
= . 5.18 


In the u, — ug coordinates it is easy to see that the origin is an unstable 
equilibrium point. 
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Step 5. Compute e4t = Te“'T—1. 


We have: 


At _ 


o 
lI | 
Nl rR NLR 
a fr 
| | 
ao 
a 
Se” 
a SOS 
fan) 
w 
a fo 
a | 
w 
a fe 
Sa” 


et + e8t et 4 eit laa 
—el + @%# et + et } 
We see that the origin is also unstable in the original x1 — x2 coordinates. 
It is referred to as a source, and this is characterized by the fact that 
all of the eigenvalues of A have positive real part. The phase portrait is 
illustrated in Fig. 5.1. 


We remark this it is possible to infer the behavior of e4¢ as t + oo from 
the behavior of e4* as t > oo since T does not depend on t. 


Nle 


x2 


xy 


Fig. 5.1. Phase plane of (5.19). The origin is unstable — a source. 
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Example 11. We consider the following linear, autonomous ODE: 
(3) 2 * a) el (5.20) 
v2 2 =I r2 


A= & 1): (521) 


Step 1. Compute the eigenvalues of A. 


where 


The eigenvalues of A, denote by 4, are given by the solutions of the char- 
acteristic polynomial: 


= ; 
det = (-1-A)°+9=0, 
9 th) 
= \°+24+10=0. (5.22) 

or, 


i 
2 


The eigenvectors are complex, so we know it is not diagonalizable over the 


V4—40 = -1+ 31. 


Ai,2=-l4 


real numbers. What this means is that we cannot find real eigenvectors so 
that it can be transformed to a form where there are real numbers on the 
diagonal, and zeros in the off diagonal entries. The best we can do is to 
transform it to a form where the real parts of the eigenvalue are on the 
diagonal, and the imaginary parts are on the off diagonal locations, but 
the off diagonal elements differ by a minus sign. 


Step 2. Compute the eigenvectors of A. 


The eigenvector of A corresponding to the eigenvector —1—3: is the solution 
of the following equations: 


€ =) (*:) =(13) (") (5.23) 


Xy t= —-Ty 3121, (5.24) 


921 — fy S — Lp — 312%. (5.25) 
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A solution to these equations is given by: 


1\ /1 +5 0 
a) 10)" \ay 
Step 3. Use the eigenvectors of A to form the transformation 


matrix T. 


For the first column of T we take the real part of the eigenvector corre- 
sponding to the eigenvalue —1— 37, and for the second column we take the 
complex part of the eigenvector: 


T (5.26) 


= =a 5.27 


Step 4. Compute A = T~' AT. 


with inverse 


We have: 
1 0 -1 -1l 1 0 
ai, _ 
mare(S (3 a) (0 3) 
(| ‘) ( 3 ) 
= 1 _ 5 
0 ¢ 9 3 
—-1 -3\ _ 
= ( 3 7) =A. (5.28) 
With A in this form, we know from the previous chapter that: 
cos3t —sin3t 
eAt — et (5.29) 
sin 3t cos 3t 


Then we have: 
eAt = Tet}, 


At _, 0 as t + oo. Hence 


the origin is asymptotically stable. It is referred to as a sink and it is 
characterized by the real parts of the eigenvalues of A being negative. The 
phase plane is sketched in Fig. 5.2. 


From this expression we can conclude that e 
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Xy 


x] 


Fig. 5.2. Phase plane of (5.20). The origin is a sink. 


Example 12. We consider the following linear autonomous ODE: 


(") - & : ("). (5.30) 


A= & a (5.31) 


Step 1. Compute the eigenvalues of A. 


where 


The eigenvalues are given by the solution of the characteristic equation: 


ve (“? : )=« =A Ayo 10, 


1 dice), 
= -2=0, (5.32) 


which are: 
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Step 2. Compute the eigenvectors of A. 


The eigenvector corresponding to the eigenvalue V2 is given by the solution 
of the following equations: 


GQ)-4) 6s 


—%4,+%Q = V2r1, (5.34) 
+X = V22r9. (5.35) 


or 


A solution is given by: 
w2= (1 + V2)x1, 


corresponding to the eigenvector: 


(va) 


The eigenvector corresponding to the eigenvalue —/2 is given by the 
solution to the following equations: 


Ghy(s)-a(s) os 


—€+% = —/221, (5.37) 
ay +22 = —V 22. (5.38) 


or 


A solution is given by: 
LQ = (1 = V2)a1, 


corresponding to the eigenvector: 


(1.2) 
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Step 3. Use the eigenvectors of A to form the transformation 
matrix T. 


For the columns of T' we take the eigenvectors corresponding to the eigen- 


values V2 and —v2: 


1 1 
re 7 (5.39) 


ar... il tov2 =1 
‘i =r (5 i) (5.40) 


Step 4. Compute A = T~' AT. 


with T~! given by: 


We have: 
ee. l=W2 =1\ f=1 1 1 1 
‘ ara—sie( ios J 1 1) ee a) 
ill 1-V2 -1 V2 —V/2 
~ Of \-1-/72 1) \2a4v2 2-va)’ 


1 /-4 0 V2 a 
=->5( ; aa : a) =* (5.41) 


Therefore in the wu; — w2 coordinates (5.30) takes the form: 


U4 V2 0 Ut 
SC) 


The phase portrait of (5.42) is shown in Fig. 5.3. 

It is easy to see that the origin is unstable for (5.42). In Fig. 5.3 we see 
that the origin has the structure of a saddle point, and we want to explore 
this idea further. 

In the ui — ug coordinates the span of the eigenvector corresponding 
to the eigenvalue V2 is given by uz = 0, ie. the w;-axis. The span of 
the eigenvector corresponding to the eigenvalue — V2 is given by u, = 0, 
i.e. the ug-axis. Moreover, we can see from the form of (5.42) that these 
coordinate axes are invariant. The wu -axis is referred to as the unstable 
subspace, denoted by E“, and the u2-axis is referred to as the stable sub- 
space, denoted by E*. In other words, the unstable subspace is the span 


54 Ordinary Differential Equations: A Dynamical Point of View 


uy 


Fig. 5.3. Phase portrait of (5.42). 


of the eigenvector corresponding to the eigenvalue with positive real part 
and the stable subspace is the span of the eigenvector corresponding to the 
eigenvalue having negative real part. The stable and unstable subspaces 
are invariant subspaces with respect to the flow generated by (5.42). 

The stable and unstable subspaces correspond to the coordinate axes in 
the coordinate system given by the eigenvectors. Next we want to under- 
stand how they would appear in the original «,—x2 coordinates. This is 
accomplished by transforming them to the original coordinates using the 
transformation matrix (5.39). 

We first transform the unstable subspace from the u,—u2 coordinates 
to the 21-22 coordinates. In the u,—u2 coordinates points on the unstable 
subspace have coordinates (u,0). Acting on these points with T gives: 


1 1 Be 
U1 U1 1 

T = = F 5.48 
(¢) er a (") oe) 
which gives the following relation between points on the unstable subspace 
in the u,—u2 coordinates to points in the 71-272 coordinates: 


Uy = Vy (5.44) 
(1+ V2)u = 2x2, (5.45) 
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xX} 


Fig. 5.4. The unstable subspace in the original coordinates. 


or 
(1+ V2)a, = 2p. (5.46) 


This is the equation for the unstable subspace in the 71-22 coordinates, 
which we illustrate in Fig. 5.4. 

Next we transform the stable subspace from the u,—u2 coordinates to 
the 21-22 coordinates. In the u,—uz coordinates points on the stable sub- 
space have coordinates (0, u2). Acting on these points with T gives: 


tO) (ia <a) (2)- (2). eeu 


which gives the following relation between points on the stable subspace in 
the u,—ug coordinates to points in the x1—ax2 coordinates: 


or 
(1— V2)x, = 2. (5.50) 


This is the equation for the stable subspace in the x|—«2 coordinates, which 
we illustrate in Fig. 5.5. 
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xy 


Fig. 5.5. The stable subspace in the original coordinates. 


xX} 


Fig. 5.6. The stable and unstable subspaces in the original coordinates. 


In Fig. 5.6 we illustrate both the stable and the unstable subspaces in 
the original coordinates. 


Now we want to discuss some general results from these three examples. 
For all three examples, the real parts of the eigenvalues of A were 
nonzero, and stability of the origin was determined by the sign of the real 
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parts of the eigenvalues, e.g. for Example 10, the origin was unstable (the 
real parts of the eigenvalues of A were positive), for Example 11, the origin 
was stable (the real parts of the eigenvalues of A were negative), and for 
Example 12, the origin was unstable (A had one positive eigenvalue and 
one negative eigenvalue). This is generally true for all linear, autonomous 
vector fields. We state this more formally. 

Consider a linear, autonomous vector field on R”: 


y=Ay, y(0)=yo, yEeR". (5.51) 


Then if A has no eigenvalues having zero real parts, the stability of the 
origin is determined by the real parts of the eigenvalues of A. If all of the 
real parts of the eigenvalues are strictly less than zero, then the origin is 
asymptotically stable. If at least one of the eigenvalues of A has real part 
strictly larger than zero, then the origin is unstable. 

There is a term applied to this terminology that permeates all of dynam- 
ical systems theory. 


Definition 20 (Hyperbolic Equilibrium Point). The origin of (5.51) 
is said to be hyperbolic if none of the real parts of the eigenvalues of A 
have zero real parts. 


It follows that hyperbolic equilibria of linear, autonomous vector fields 
on R” can be either sinks, sources, or saddles. The key point is that the 
eigenvalues of A all have nonzero real parts. 

If we restrict ourselves to two dimensions, it is possible to make a (short) 
list of all of the distinct canonical forms for A. These are given by the 
following six 2 x 2 matrices. 

The first is a diagonal matrix with real, nonzero eigenvalues A, 4 4 0, 
i.e. the origin is a hyperbolic fixed point: 


A 0 
(: °) 9 


In this case the orgin can be a sink if both eigenvalues are negative, a 
source if both eigenvalues are positive, and a saddle if the eigenvalues have 
opposite sign. 

The next situation corresponds to complex eigenvalues, with the real 
part, a, and imaginary part, 0, both being nonzero. In this case, the equi- 
librium point is hyperbolic, and a sink for a < 0, and a source for a > 0. 
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The sign of 6 does not influence stability: 


& ’). (5.53) 


Next we consider the case when the eigenvalues are real, identical, and 
nonzero, but the matrix is nondiagonalizable, i.e. two eigenvectors cannot 
be found. In this case, the origin is hyperbolic for A 4 0, and is a sink for 


A <0 and a source for A > 0: 
A 1 
: 5.54 
(; ‘) 6.54) 


Next, we consider some cases corresponding to the origin being non- 
hyperbolic that would have been possible to include in the discussion of 
earlier cases, but it is more instructive to explicitly point out these cases 
separately. 

We first consider the case where A is diagonalizable with one nonzero 
real eigenvalue and one zero eigenvalue: 


d 0 
(; i (5.55) 


We consider the case where the two eigenvalues are purely imaginary, 
+i,/B. In this case the origin is referred to as a center. 


0 £6 
& a (5.56) 


For completeness, we consider the case where both eigenvalues are zero 


(j a (5.57) 


Finally, we want to expand on the discussion related to the geometri- 
cal aspects of Example 12. Recall that for that example the span of the 
eigenvector corresponding to the eigenvalue with negative real part was an 
invariant subspace, referred to as the stable subspace. Trajectories with ini- 
tial conditions in the stable subspace decayed to zero at an exponential rate 
as t — +00. The stable invariant subspace was denoted by E*. Similarly, 
the span of the eigenvector corresponding to the eigenvalue with positive 


and A is diagonal. 


real part was an invariant subspace, referred to as the unstable subspace. 
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Trajectories with initial conditions in the unstable subspace decayed to zero 
at an exponential rate as t + —oo. The unstable invariant subspace was 
denoted by E”. 

We can easily see that (5.52) has this behavior when \ and z have oppo- 
site signs. If A and yw are both negative, then the span of the eigenvectors 
corresponding to these two eigenvalues is R?, and the entire phase space is 
the stable subspace. Similarly, if \ and ys are both positive, then the span 
of the eigenvectors corresponding to these two eigenvalues is R?, and the 
entire phase space is the unstable subspace. 

The case (5.53) is similar. For that case there is not a pair of real 
eigenvectors corresponding to each of the complex eigenvalues. The vectors 
that transform the original matrix to this canonical form are referred to as 
generalized eigenvectors. If a < 0 the span of the generalized eigenvectors 
is R?, and the entire phase space is the stable subspace. Similarly, if a > 0 
the span of the generalized eigenvectors is R?, and the entire phase space 
is the unstable subspace. The situation is similar for (5.54). For A < 0 the 
entire phase space is the stable subspace, for \ > 0 the entire phase space 
is the unstable subspace. 

The case (5.55) is different. The span of the eigenvector corresponding 
to A is the stable subspace for \ < 0, and the unstable subspace for A > 0. 
The space of the eigenvector corresponding to the zero eigenvalue is referred 
to as the center subspace. 

For the case (5.56) there are no two real eigenvectors leading to the 
resulting canonical form. Rather, there are two generalized eigenvectors 
associated with this pair of complex eigenvalues having zero real part. The 
span of these two eigenvectors is a two-dimensional center subspace corre- 
sponding to R?. An equilibrium point with purely imaginary eigenvalues 
is referred to as a center. 

Finally, the case (5.57) is included for completeness. It is the zero vector 
field where R? is the center subspace. 

We can characterize stability of the origin in terms of the stable, unsta- 
ble, and center subspaces. The origin is asymptotically stable if EY = © 
and £° = ©. The origin is unstable if EY 4 O. 


Problem Set 5 


1. Suppose A is a n X n matrix of real numbers. Show that if \ is an 
eigenvalue of A with eigenvector e, then A is an eigenvalue of A with 
eigenvector @. 
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2. Consider the matrices: 


0 — 0 
Pe OO iene: ae ee (5.58) 
Ww 0) —w 0 


Sketch the trajectories of the associated linear autonomous ordinary 
differential equations: 


() -4(%), i=1,2. (5.59) 
vg v2 


3. Consider the matrix 
—1 -1 
A= ( 9 = (5.60) 


(a) Show that the eigenvalues and eigenvectors are given by: 


St 
nese (4)=()-1() 


(b) Consider the four matrices: 


(5.61) 


= (_§ a m= (5 Al (5.62) 


Compute Ay = 1 * AT = 1,...,4. 
(c) Discuss the form of T in terms of the eigenvectors of A.? 


4. Consider the following two-dimensional linear autonomous vector field: 


() Z & : (*). (#1 (0), #2(0)) = Gerp,220)- (6-63) 


Show that the origin is Lyapunov stable. Compute and sketch the 
trajectories. 


?The point ot this problem is to show that when you have complex eigenvalues (in the 
2 x 2 case) there is a great deal of freedom in how you compute the real canonical form. 
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. Consider the following two-dimensional linear autonomous vector field: 


(3) = ( : (*). Oat Guen, Cee 


Show that the origin is a saddle. Compute the stable and unstable 
subspaces of the origin in the original coordinates, i.e. the x, — x2 
coordinates. Sketch the trajectories in the phase plane. 

. Consider the following two-dimensional autonomous ODE on R?, 


(=\=(5 $)(2). 


with initial condition 


(1(0), v2 (0)) => (x10, X20). 


(a) Show that the x1-axis, ie. 22 = 0, is invariant, and sketch the 
direction of flow on this line. 

(b) Show that the x-axis, i.e. x; = 0, is invariant, and sketch the 
direction of flow on this line. 


(c) Compute e4*, where 
1 0 
= i —1 ) : 


(d) Use e4* to express the solution of this ODE. 
(e) Is (a1, 22) = (0,0) an equilibrium point? If it is an equilbrium 
point, what is the nature of its stability? 


. Consider the following two-dimensional linear autonomous ODE on R?, 
L=yY, 
Y=: 

(a) Show that the trajectories lie on the curves: 


1 
a =e) =C, (5.65) 
where C is a constant. 


(b) Show that 
x—-y=0, and r+y=0. 


are invariant lines. How do these invariant lines relate to (5.65) 
and the constant C? 
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(c) Sketch these invariant lines in the phase plane and _ indicate 
the direction of flow along these lines. Sketch some trajectories 
between these invariant lines, and indicate the direction of flow 
along the lines that you sketch. 

(d) How do these invariant lines relate to the stable and unstable sub- 
spaces of the origin? 


8. Consider the following two-dimensional linear autonomous ODE on R?, 
t=y, 
y= —-2. 


(a) Show that the trajectories lie on the curves: 


: (y? +2*) =C, (5.66) 


where C is a constant. 


9. Consider the following two-dimensional autonomous ODE on R?, 
x1 —-1 -l x1 
= 5.67 


-1 -l 
A= : 
Cs) 
(a) Compute e4*. 


(b) Give equations for the invariant subspaces of (5.67) in the x1—«2 
coordinates and describe their stability, i.e. are they stable, unsta- 
ble, or center subspaces? 


and we define 


10. Consider the following two-dimensional autonomous ODE on R?, 
(2 )-( i) (*) (5.68) 
4 on) 1 ol x2 
1 1 
A= F 
(3) 


(a) What do you know about the eigenvalues and eigenvectors of A 
without doing any calculations? 
(b) Compute e4*. 


and we define 


11. 


12. 
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(c) Give equations for the invariant subspaces of (5.68) in the 2-22 
coordinates and describe their stability, i.e. are they stable, unsta- 
ble, or center subspaces? 


Consider the following two-dimensional autonomous ODE on R?, 


- © 6) (") (5.69) 


and we define 


(a) Compute e4*. 

(b) Give equations for the invariant subspaces of (5.69) in the x—a2 
coordinates and describe their stability, i.e. are they stable, unsta- 
ble, or center subspaces? 


Consider the following two-dimensional autonomous ODE on R?, 
ty -1 3 Dy 
= 5.70 
( £2 ( -1 3 ) ( X2 ene) 


—-1 3 
ro & a 
(a) Compute e4*. 


(b) Give equations for the invariant subspaces of (5.70) in the x—a2 
coordinates and describe their stability, i.e. are they stable, unsta- 
ble, or center subspaces? 


and we define 
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Chapter 6 


Stable and Unstable Manifolds 
of Hyperbolic Equilibria 


FOR HYPERBOLIC EQUILIBRIA OF AUTONOMOUS VECTOR FIELDS, THE 
LINEARIZATION CAPTURES THE LOCAL BEHAVIOR NEAR THE EQUILIB- 
RIA FOR THE NONLINEAR VECTOR FIELD. We describe the results jus- 
tifying this statement in the context of two-dimensional autonomous 
systems.! 

We consider a C", r > 1 two-dimensional autonomous vector field of 
the following form: 


&= f(x,y), 


y=g(z,y), (x,y) € R?. (6.1) 


Let ¢;(-) denote the flow generated by (6.1). Suppose (2, yo) is a hyper- 
bolic equilibrium point of this vector field, i.e. the two eigenvalues of the 
Jacobian matrix: 


a a 
5£ (ao, Yo) 54 (x0, yo) 


a a 
35 (Zo, Yo) 35 (Lo, Yo) 


1An extremely complete and thorough exposition of “hyperbolic theory” is given in 
A. Katok and B. Hasselblatt. Introduction to the Modern Theory of Dynamical Systems, 
Volume 54. Cambridge University Press, 1997. 
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have nonzero real parts. There are three cases to consider: 


e (x9, Yo) is a source for the linearized vector field, 
e (x9, Yo) is a sink for the linearized vector field, 
e (x0, Yo) is a saddle for the linearized vector field. 


We consider each case individually.” 
(Zo, Yo) is a source. 


In this case (29, ¥9) is a source for (6.1). More precisely, there exists a 
neighborhood U of (xo, yo) such that for any p € U, ¢;(p) leaves U as t 
increases. 


(Zo, Yo) is a sink. 


In this case (x9, yo) is a sink for (6.1). More precisely, there exists a neigh- 
borhood S of (29, yo) such that for any p € S, ¢:(p) approaches (29, yo) at 
an exponential rate as t increases. In this case (9, yo) is an example of an 
attracting set and its basin of attraction is given by: 


B= (J ¢(8). 


t<0 
(2, Yo) is a saddle. 


For the case of hyperbolic saddle points, the saddle point structure is still 
retained near the equilibrium point for nonlinear systems. We now explain 
precisely what this means. In order to do this we will need to examine 
(6.1) more closely. In particular, we will need to transform (6.1) to a coor- 
dinate system that “localizes” the behavior near the equilibrium point and 
specifically displays the structure of the linear part. We have already done 
this in the previous two chapters in examining the behavior near specific 
solutions, so we will not repeat those details. 

Transforming locally near (xo, yo) in this manner, we can express (6.1) 
in the following form: 


é\_(-e o\(é u(£,7) ; 
Or 0 ’) Gob a,B>0, (7) eR’, (6.2) 


?Details of the stability results for the hyperbolic source and sink can be found in M. W. 
Hirsch, S. Smale, and R. L. Devaney. Differential Equations, Dynamical Systems, and 
an Introduction to Chaos. Academic Press, 2012. 
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where the Jacobian at the origin, 
—a 0 
0 6 


reflects the hyperbolic nature of the equilibrium point. The linearization 
of (6.1) about the origin is given by: 


(6.3) 


-a 0 
es o\ (6.4) 
" 0 6} \n 
It is easy to see for the linearized system that 
E* = {(&)|7 = 0}, (6.5) 
is the invariant stable subspace and 
E“ = {(€,7)|€ = 0}, (6.6) 


is the invariant unstable subspace. 

We now state how this saddle point structure is inherited by the nonlin- 
ear system by stating the results of the stable and unstable manifold theorem 
for hyperbolic equilibria for two-dimensional autonomous vector fields.? 

First, we consider two intervals of the coordinate axes containing the 
origin as follows: 


Ig ={-€<€ <e}, (6.7) 
and 
I, = {-e<n<e}, (6.8) 


for some small € > 0. A neighborhood of the origin is constructed by taking 
the cartesian product of these two intervals: 


B. = {(€,n) € R” | (En) € Le x In}, (6.9) 


3The stable and unstable manifold theorem for hyperbolic equilibria of autonomous 
vector fields is a fundamental result. The proof requires some preliminary work to 
develop the appropriate mathematical setting in order for the proof to proceed. Of 
course, before one proves a result one must have a through understanding of the result 
that one hopes to prove. For this reason we focus on explicit examples here. See, for 
example E. A. Coddington and N. Levinson. Theory of Ordinary Differential Equations. 
Krieger, 1984; P. Hartman. Ordinary Differential Equations. Society for industrial and 
Applied Mathematics, 2002; J. K. Hale. Ordinary Differential Equations. Dover, 2009; 
and C. Chicone. Ordinary Differential Equations with Applications. Springer, 2000. 
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Wy, ((0.0)) 


Fig. 6.1. The neighborhood of the origin, B., showing the local stable and unstable 
manifolds. 


and it is illustrated in Fig. 6.1. The stable and unstable manifold theorem 
for hyperbolic equilibrium points of autonomous vector fields states the 
following. 

There exists a C” curve, given by the graph of a function of the € 
variables: 


n=S(§), €€ de, (6.10) 


This curve has three important properties. 


It passes through the origin, i.e. S(0) = 0. 

It is tangent to £* at the origin, i.e. a3 (0) =0. 

It is locally invariant in the sense that any trajectory starting on the curve 
approaches the origin at an exponential rate as t > oo, and it leaves B, as 


t—- —o. 
Moreover, the curve satisfying these three properties is unique. For these 


reasons, this curve is referred to as the local stable manifold of the origin, 
and it is denoted by: 


Wys- ((0;9)) = {(60) € Beln = S(€)}. (6.11) 
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Similarly, there exists another C” curve, given by the graph of a function 
of the 7 variables: 


is = U(n), 7) € Tn, (6.12) 


This curve has three important properties. 


It passes through the origin, i.e. U(0) = 0. 

It is tangent to £“ at the origin, ie. (0) =0. 

It is locally invariant in the sense that any trajectory starting on the curve 
approaches the origin at an exponential rate as t + —oo, and it leaves B, 


as t > oo. 


For these reasons, this curve is referred to as the local unstable manifold 
of the origin, and it is denoted by: 


Wioc ((0,0)) = {(67) € BelE = U(n)} . (6.13) 


The curve satisfying these three properties is unique. 
These local stable and unstable manifolds are the “seeds” for the global 
stable and unstable manifolds that are defined as follows: 


W* ((0,0)) = J d (Wig, ((0,0))), (6.14) 
t<0 
and 
Ww" ((0,0)) = L) ¢: (Wik. (0, 0))). (6.15) 
t>0 


Now we will consider a series of examples showing how these ideas are 
used. 


Example 13. We consider the following autonomous, nonlinear vector field 
on the plane: 


CHT, 
y= —yta2’, (2,y) € R?. (6.16) 


This vector field has an equilibrium point at the origin, (x,y) = (0,0). The 
Jacobian of the vector field evaluated at the origin is given by: 


& et) (6.17) 
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From this calculation we can conclude that the origin is a hyperbolic sad- 
dle point. Moreover, the x-axis is the unstable subspace for the linearized 
vector field and the y-axis is the stable subspace for the linearized vector 
field. 

Next we consider the nonlinear vector field (6.16). By inspection, we 
see that the y-axis (ie. 2 = 0) is the global stable manifold for the origin. 
We next consider the unstable manifold. Dividing the second equation by 
the first equation in (6.16) gives: 


a ee (6.18) 


This is a linear nonautonomous equation.* A solution of this equation pass- 
ing through the origin is given by: 


y=. (6.19) 


It is also tangent to the unstable subspace at the origin. It is the global 
unstable manifold.° 

We examine this statement further. It is easy to compute the flow gen- 
erated by (6.16). The a component can be solved and substituted into the 
y component to yield a first order linear nonautonomous equation. Hence, 
the flow generated by (6.16) is given by®: 


a(t, 29) = zoe’, 


2 


y(t, Yo) = (1 $ =) et + Det, (6.20) 


The global unstable manifold of the origin is the set of initial conditions 
having the property that the trajectories through these initial conditions 
approach the origin at an exponential rate as t + —oo. On examining the 
two components of (6.20), we see that the 2 component approaches zero as 
t — —oo for any choice of x9. However, the y component will only approach 


4This linear first order equation can be solved in the usual way with an integrating 
factor. See Appendix B for details of this procedure. 

5You should verify that this curve is invariant. In terms of the vector field, invariance 
means that the vector field is tangent to the curve. Why? 

6 Again, the equation is solved in the usual way by using an integrating factor, see 
Appendix B for details. 
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zero as t +> —oo if yo and po are chosen such that 
yo = 2. (6.21) 


Hence (6.21) is the global unstable manifold of the origin.” 


Example 14. Consider the following nonlinear autonomous vector field on 
the plane: 


z£=2-—2°, 


y=-y, (x,y) eR’. (6.22) 
Note that the « and y components evolve independently. 


The equilibrium points and the Jacobians associated with their lin- 
earizations are given as follows: 


(ea) = (0,0), f ah stile (6.23) 


— 


—2 
(x,y) = (£1,0); ( 0 *) ; sinks (6.24) 
We now compute the global stable and unstable manifolds of these equi- 
libria. We begin with the saddle point at the origin. 


00,0), W*(:9)) = {@w)le = 0} a 
W* ((0,0)) = {(z,y)|-1 <2 <1, y= 0} 


For the sinks, the global stable manifold is synonomous with the basin 
of attraction for the sink. 


(1,0): W*((1,0)) = {(z, y)|a > 0} (6.26) 
(-1,0): W*((-1,0)) = {(e,y)|x < 0} (6.27) 


TEquation (6.19) characterizes the unstable manifold as an invariant curve passing 
through the origin and tangent to the unstable subspace at the origin. Equation (6.21) 
characterizes the unstable manifold in terms of the asymptotic behavior of trajectories 
(as t + —co) whose initial conditions satisfy a particular constraint, and that constraint 
is that they are on the unstable manifold of the origin. 


72 Ordinary Differential Equations: A Dynamical Point of View 


Fig. 6.2. Invariant manifold structure of (6.22). The black dots indicate equilibrium 
points. 


Example 15. In this example we consider the following nonlinear 
autonomous vector field on the plane: 


L= 2, 
y=y(1-y’), (a, y) € R?. (6.28) 


Note that the x and y components evolve independently. 
The equilibrium points and the Jacobians associated with their lin- 
earizations are given as follows: 


(x,y) = (0,0), (0, £1) (6.29) 

(x, y) = (0,0); & os not hyperbolic (6.30) 
Gra ey, (7 =) sine (6.31) 
@y\ 30.24), & a saduile (6.32) 


We now compute the global invariant manifold structure for each of the 
equilibria, beginning with (0,0). 


(0,0), W2 OOD = ( 


= {(z,y)|y = 0} 
W° ((0,0)) = {( 


xz, 
(6.33) 
x,y)|z =0, -l1<y< 1} 
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Fig. 6.3. Invariant manifold structure of (6.28). The black dots indicate equilibrium 
points. 


The z-axis is clearly the global stable manifold for this equilibrium point. 
The segment on the y-axis between —1 and 1 is invariant, but it does not 
correspond to a hyperbolic direction. It is referred to as the center mani- 
fold of the origin, and we will learn much more about invariant manifolds 
associated with nonhyperbolic directions later. 

The equilibrium point (0,1) is a sink. Its global stable manifold (basin 
of attraction) is given by: 


(0,1); W*((0,1)) = {(@@,y)ly > OF. (6.34) 


The equilibrium point (0,—1) is a saddle point with global stable and 
unstable manifolds given by: 


(0,—1); (6.35) 


Example 16. In this example, we consider the following nonlinear 
autonomous vector field on the plane: 


c=y, 


y=x—2°—dy, (2,y) ER’, 6>0, (6.36) 
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where 6 > 0 is to be viewed as a parameter. The equilibrium points are 
given by: 


(x,y) = (0,0), (41,0). (6.37) 


We want to classify the linearized stability of the equilibria. The Jacobian 
of the vector field is given by: 


0 1 
A= 6.38 
tee a ( ) 


and the eigenvalues of the Jacobian are: 
6.61 
At = —-x t= 07 4+4- 1227. : 
+ 5* 5 x (6.39) 


We evaluate this expression for the eigenvalues at each of the equilibria to 
determine their linearized stability. 


(0,0); Ag =—$+4V02 +4. (6.40) 
Note that 
O7+4> 6, 


therefore the eigenvalues are always real and of opposite sign. This implies 
that (0,0) is a saddle. 


(£1,0) A, =-$+4V02-8. (6.41) 


First, note that 
6° -—8 <6". 


This implies that these two fixed points are always sinks. However, there 
are two subcases. 


6? —8 <0: The eigenvalues have a nonzero imaginary part. 
6? —8>0: The eigenvalues are purely real. 


In Fig. 6.4 we sketch the local invariant manifold structure for these 
two cases. 

In Fig. 6.5 we sketch the global invariant manifold structure for the 
two cases. In the coming lectures we will learn how we can justify this 
figure. However, note the role that the stable manifold of the saddle plays 
in defining the basins of attractions of the two sinks. 
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y 
(a) 

y 
(b) 


Fig. 6.4. Local invariant manifold structure of (6.36). The black dots indicate equilib- 
rium points. (a) 6? —8 > 0, (b) 62-8 <0. 


SS) 
ey 


Fig. 6.5. A sketch of the global invariant manifold structure of (6.36). The black dots 
indicate equilibrium points. (a) 5? — 8 > 0, (b) 62-8 <0. 
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Problem Set 6 


. Consider the C”, r > 1, autonomous vector field on R?: 
&= f(z), 


with flow 


ot(-), 


and let x = denote a hyperbolic saddle type equilibrium point for this 
vector field. We denote the local stable and unstable manifolds of this 
equilibrium point by: 


Wi-(t), Waice(®), 


respectively. The global stable and unstable manifolds of % are defined 
by: 


(a) Show that W*(%) and W“(Z) are invariant sets. 

(b) Suppose that p € W*(Z), show that ¢;:(p) > Z at an exponential 
rate as t + oo. 

(c) Suppose that p € W“(Z), show that ¢;(p) + £ at an exponential 
rate as t — —oo. 


. Consider the C", r > 1, autonomous vector field on R? having a hyper- 
bolic saddle point. Can its stable and unstable manifolds intersect at an 
isolated point (which is not a fixed point of the vector field) as shown in 
Fig. 6.6? 
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Possible intersection of the 
stable and unstable 
manifolds of 

the hyperbolic 
fixed point? 


hyperbolic fixed point 


Fig. 6.6. Possible intersection of the stable and unstable manifolds of a hyperbolic fixed 


point? 


3. Consider the following autonomous vector field on the plane: 


L= ag, 


y= pyt yeh, (6.42) 


where a < 0, 8 > 0, y is a real number, and n is a positive integer. 


Show that the origin is a hyperbolic saddle point. 

Compute and sketch the stable and unstable subspaces of the origin. 
Show that the stable and unstable subspaces are invariant under the 
linearized dynamics. 

Show that the flow generated by this vector field is given by: 


x(t,2o) = xoe™, 
n+1 n+1 
t, 20, — ft _ Yo iis Xo er(nt ht 
y(t, Zo, Yo) ( a(n+1)— 8 a(n+1)— £8 


Compute the global stable and unstable manifolds of the origin from 
the flow. 
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(f) Show that the global stable and unstable manifolds that you have 
computed are invariant. 

(g) Sketch the global stable and unstable manifolds and discuss how 
they depend on y and n. 


Suppose « = f(x), aw € R” is a C” vector field having a hyperbolic 
fixed point, « = x9, with a homoclinic orbit. Describe the homoclinic 
orbit in terms of the stable and unstable manifolds of xo. 

Suppose « = f(x), w € R” is a C” vector field having hyperbolic 
fixed points, = xp and 21, with a heteroclinic orbit connecting xp and 
x . Describe the heteroclinic orbit in terms of the stable and unstable 
manifolds of xp and 71. 


Chapter 7 


Lyapunov’s Method and the 
LaSalle Invariance Principle 


We will next learn a method for determining stability of equilibria which 
may be applied when stability information obtained from the linearization 
of the ODE is not sufficient for determining stability information for the 
nonlinear ODE. The book by LaSalle! is an excellent supplement to this 
lecture. This is Lyapunov’s method (or Lyapunov’s second method, or the 
method of Lyapunov functions).? We begin by describing the framework 
for the method in the setting that we will use. 
We consider a general C", r > 1 autonomous ODE 


z=f(x), «eR, (7.1) 
having an equilibrium point at x7 = Z, i.e. 
f(z) =0. (7.2) 
For a scalar valued function defined on R” 


V:R" SR, 
rH V(a), (7.3) 


lJ, P. LaSalle. The Stability of Dynamical Systems, Volume 25. SIAM, 1976. 

2The original work of Lyapunov is reprinted as below and an excellent perspective of 
Lyapunov’s work is given in Parks as well A. M. Lyapunov. General Problem of the 
Stability of Motion. Control Theory and Applications Series. Taylor & Francis, 1992; 
and P. C. Parks. A. M. Lyapunov’s stability theory — 100 years on. IMA Journal of 
Mathematical Control and Information, 9(4):275-303, 1992. 
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we define the derivative of (7.3) along trajectories of (7.1) by: 


d 
av ) =V(a2) =VV(a)- 4, 


= VV(a)- f(z). (7.4) 
We can now state Lyapunov’s theorem on the stability of the equilibrium 
point «= Z. 
Theorem 1. Consider the following C” (r > 1) autonomous vector field 
on R”: 
t= f(x), «ER. (7.5) 
Let x = & be an equilibrium point of (7.5) and let V: U > R be a Ct 


function defined in some neighborhood U of & such that: 


=0 and V(x) >0 ifa FG. 
2. V(x) <0 inU — {3} 


Then & is Lyapunov stable. Moreover, if 


V(x) <0 inU—{z} 
then & is asymptotically stable. 


The function V (a) is referred to as a Lyapunov function. 
We now consider an example. 


Example 17. 

t=y, 

y=—x—ex*y, (2,y) € R’, (7.6) 
where ¢€ is a parameter. It is clear that (7,y) = (0,0) is an equilibrium 
point of (7.6) and we want to determine the nature of its stability. 


We begin by linearizing (7.6) about this equilibrium point. The matrix 
associated with this linearization is given by: 


Ac (| >) (7.7) 


and its eigenvalues are +7. Hence, the origin is not hyperbolic and therefore 
the information provided by the linearization of (7.6) about (a, y) = (0,0) 
does not provide information about stability of (x,y) = (0,0) for the 
nonlinear system (7.6). 
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Therefore we will attempt to apply Lyapunov’s method to determine 
the stability of the origin. 
We take as a Lyapunov function: 


V(a,y) = 5(0? +92), (7.8) 


Note that V(0,0) = 0 and V(a,y) > 0 in any neighborhood of the origin. 
Moreover, we have: 
. OV. OV 


zy + y(—x — ex7y), 


= —ex"y’, 
<0, fore>0. (7.9) 
Hence, it follows from Theorem 1 that the origin is Lyapunov stable.? 


Next we will introduce the LaSalle invariance principle.4 Rather than 
focus on the particular question of stability of an equilibrium solution as in 
Lyapunov’s method, the LaSalle invariance principle gives conditions that 
describe the behavior as t > oo of all solutions of an autonomous ODE. 

We begin with an autonomous ODE defined on R”: 


t=f(x), «ER (7.10) 


where f(a) is C”, (r > 1). Let ¢;(-) denote the flow generated by (7.10) 
and let M Cc R” denote a positive invariant set that is compact (i.e. closed 
and bounded in this setting). Suppose we have a scalar valued function 


V:R° OR, (7.11) 


such that 


V(x) <0 inM (7.12) 


(Note the “less than or equal to” in this inequality.) 


3The obvious question that comes up at this point is, how do I find the Lyapunov 
function? We discuss this issue in Appendix C. 

4The original paper is a technical report that can be found on the internet. See 
also J. P. LaSalle. An invariance principle in the theory of stability. Technical Report 
66-1, Brown University, 1966; J. P. LaSalle. The Stability of Dynamical Systems, 
Volume 25. SIAM, 1976; and I. Barkana. Defending the beauty of the invariance 
principle. International Journal of Control, 87(1):186—206, 2014. 
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Let 
E= {re M|V(2) =6} (7.13) 
and 
= ee union of alll ubayecbonics that ae, (7.14) 
in # and remain in F for all t > 0 
Now we can state LaSalle’s invariance principle. 
Theorem 2. For all x eM, ¢:(2) > M ast > oo. 
We will now consider an example. 
Example 18. Consider the following vector field on R?: 
r=y, 
y=x—a2°—dy, (2,y) eR’, 5>0. (7.15) 


This vector field has three equilibrium points — a saddle point at (x,y) = 
(0,0) and two sinks at (x,y) = (+, 1,0). 
Consider the function 


2 2 4 
y x x 
at eagey ce g C 1 
Vay) = SSF (7.16) 
and its level sets: 
V(z,y) =C. 


We compute the derivative of V along trajectories of (7.15): 


. OV. ov. 


=(-2+2°)y+y(x — 2? — dy). 
= —dy’, (7.17) 


from which it follows that 


V(a,y) <0 on V(a,y) =C. 


Lyapunov’s Method and the LaSalle Invariance Principle 83 


Therefore, for C' sufficiently large, the corresponding level set of V bounds a 
compact positive invariant set, M, containing the three equilibrium points 
of (7.15). 

Next we determine the nature of the set 


E ={(z,y) €M|V(zx,y) = 0}. (7.18) 
Using (7.17) we see that: 

E={(a,y)—eM|y=00M}. (7.19) 
The only points in F that remain in EF for all time are: 


M ={(+1,0), (0,0)}. (7.20) 


Therefore it follows from Theorem 2 that given any initial condition in 
M, the trajectory starting at that initial condition approaches one of the 
three equilibrium points as t > oo. 


Autonomous Vector Fields on the Plane; Bendixson’s 
Criterion and the Index Theorem 


Now we will consider some useful results that apply to vector fields on the 
plane. 

First we will consider a simple, and easy to apply, criterion that rules 
out the existence of periodic orbits for autonomous vector fields on the 
plane (e.g. it is not valid for vector fields on the two torus). 

We consider a C", r > 1 vector field on the plane of the following form: 


L= nacre pe 
y=g(z,y), (x,y) €R?. (7.21) 


The following criterion due to Bendixson provides a simple, computable 
condition that rules out the existence of periodic orbits in certain regions 
of R?. 


Theorem 3 (Bendixson’s Criterion). If on a simply connected region 
D CR? the expression 


ar 


ae (x,y) + OO iy, (7.22) 


Oy 


is not identically zero and does not change sign then (7.21) has no periodic 
orbits lying entirely in D. 
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Example 19. A proof of this result can be found in Footnote 5. We con- 
sider the following nonlinear autonomous vector field on the plane: 


t=y= f(x,y), 
y=ax—2°—dy=g(z,y), (2,y) eR’, 6>0. (7.23) 


Computing (7.22) gives: 


Of | Og 
fA aa ey 24 
a (7.24) 


Therefore, this vector field has no periodic orbits for 6 4 0. 


Example 20. We consider the following linear autonomous vector field on 
the plane: 


&=ax+ by= f(x,y), 
y=cr+dy=og(z,y), (2,y)€R’, a,b,c,dEeR (7.25) 


Computing (7.22) gives: 
—+—=a4d. (7.26) 
y 
Therefore, for a +d ¥# 0, this vector field has no periodic orbits. 


Next we will consider the index theorem. The index theorem is a very 
useful tool for determining whether or not a phase portrait that you have 
computed is “complete” or “correct” in the sense that it provides a con- 
straint on the stability types of the equilibria with respect to the number 
of equilibria as well as the number and stability types of equilibria that can 
be contained within a closed trajectory. Proofs of the index theorem are 
not so common in ordinary differential equations textbooks as they rely on 
concepts that are more fully developed in differential topology® or algebraic 
topology.’ This further highlights the breadth of mathematical ideas that 
are used in the study of ODEs. 


58. Wiggins. Introduction to Applied Nonlinear Dynamical Systems and Chaos, 
Volume 2. Springer Science & Business Media, 2003. 

6V. Guillemin and A. Pollack. Differential Topology, Volume 370. American Mathe- 
matical Soc., 2010. 

TW. Fulton. Algebraic Topology: A First Course, Volume 153. Springer Science & 
Business Media, 2013. 
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Theorem 4. Inside any periodic orbit there must be at least one fixed 
point. If there is only one, then it must be a sink, source, or center. If all 
the fixed points inside the periodic orbit are hyperbolic, then there must be 
an odd number, 2n +1, of which n are saddles, andn+1 are either sinks 
or sources. 


Example 21. We consider the following nonlinear autonomous vector field 
on the plane: 


£=y=f(z,y), 
you—2 —dy+e°y=g(z,y), (ey) ER’, (7.27) 


where 6 > 0. The equilibrium points are given by: 


(x, y) = (0, 0), (+1, 0). 


The Jacobian of the vector field, denoted by A, is given by: 


0 1 
A= (7.28) 
1—3274+22y -—d+42? 
Using the general expression for the eigenvalues for a 2 x 2 matrix A: 
trA 1 
Me = —— + = V(r A? — 4 det A, 
’ 2 2 
we obtain the following expression for the eigenvalues of the Jacobian: 
-§+27 1 
die —— + 5V(-6 + a?) + ACI — 30? + 2cy) (7.29) 


If we substitute the locations of the equilibria into this expression we obtain 
the following values for the eigenvalues of the Jacobian of the vector field 


evaluated at the respective equilibria: 
6. 1 
(0, 0) A1,2 = =) — 5 6? + 4 (7.30) 
—d+1 1 
(41,0) Mas +5VCeFIP-8 (7.31) 
From these expressions, we conclude that (0,0) is a saddle for all values of 


5 and (+1,0) are 


sinks for 6>1 
centers for 6=1 (7.32) 
sources for 0<6d<1 
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x=-V6 x= V6 


(c) 


Fig. 7.1. The case 6 > 1. Possibilities for periodic orbits that satisfy Bendixson’s cri- 
terion. However, (b) is not possible because it violates the index theorem. 


Now we will use Bendixson’s criterion and the index theorem to deter- 
mine regions in the phase plane where periodic orbits may exist. For this 
example, (7.22) is given by: 


—§+2". (7:33) 


Hence the two vertical lines « = —6 and « = V6 divide the phase plane 
into three regions where periodic orbits cannot exist entirely in one of these 
regions (or else Bendixson’s criterion would be violated). There are two 
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Fig. 7.2. The case 0 < 6 < 1. Possibilities for periodic orbits that satisfy Bendixson’s 
criterion. However, (e) is not possible because it violates the index theorem. 


cases to be considered for the location of these vertical lines with respect 
to the equilibria: 6 > 1 and0 <6 <1. 

In Fig. 7.1 we show three possibilities (they do not exhaust all possible 
cases) for the existence of periodic orbits that would satisfy Bendixson’s 
criterion in the case 6 > 1. However, (b) is not possible because it violates 
the index theorem. 

In Fig. 7.2 we show three possibilities (they do not exhaust all possible 
cases) for the existence of periodic orbits that would satisfy Bendixson’s 
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criterion in the case 0 < 6 < 1. However, (e) is not possible because it 
violates the index theorem. 


Problem Set 7 


1. Consider the following autonomous vector field on the plane: 


L=y, 


y=a—2° — oy, 6>0, (x,y) € R?. 


Use Lyapunov’s method to show that the equilibria (x, y) = (+1,0) are 
Lyapunov stable for 6 = 0 and asymptotically stable for 6 > 0. 


. Consider the following autonomous vector field on the plane: 


r= Y, 
y=—a—ex*y, e>O0, (x,y) € R*. 
Use the LaSalle invariance principle to show that 
(x,y) = (0,0), 
is asymptotically stable. 
Consider the following autonomous vector field on the plane: 
zr=y, 


3 


y=r—-2®—-ax’y, a>O0, (x,y) €R’, 


use the LaSalle invariance principle to describe the fate of all trajecto- 
ries as t + oo. 
Consider the following autonomous vector field on the plane: 
z= y, 
y=a-sx?+ary, (2,y)€R’, 
where a is areal parameter. Determine the equilibria and discuss their 


linearized stability as a function of a. 
Consider the following autonomous vector field on the plane: 


&=ax + by, 
yaeatdy, (x,y) ER, (7.34) 


where a, b, c,d € R. In the questions below you are asked to give 
conditions on the constants a, b, c, and d so that particular dynamical 
phenomena are satisfied. You do not have to give all possible conditions 
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on the constants in order for the dynamical condition to be satisfied. 
One condition will be sufficient, but you must justify your answer. 


(a) Give conditions on a, b, c, d for which the vector field has no peri- 
odic orbits. 

(b) Give conditions on a, b, c, d for which all of the orbits are periodic. 

(c) Using 


Vay) = 5(0? +9?) 


as a Lyapunov function, give conditions on a, b, c, d for which 
(x,y) = (0,0) is asymptotically stable. 

(d) Give conditions on a, b, c, d for which x = 0 is the stable manifold 
of (a, y) = (0,0) and y = 0 is the unstable manifold of (x,y) = 
(0, 0). 


. Consider the following autonomous vector field on the plane: 


t= y, 
; ay 2 
ae oar (x,y) € R’. (7.35) 

(a) Determine the linearized stability of (x,y) = (0,0). 

(b) Describe the invariant manifold structure for the linearization of 
(7.35) about (a, y) = (0,0). 

(c) Using V(x, y) = $(2? + y?) as a Lyapunov function, what can you 
conclude about the stability of the origin? Does this agree with the 
linearized stability result obtained above? Why or why not? 

(d) Using the LaSalle invariance principle, determine the fate of a 
trajectory starting at an arbitrary initial condition as t — oo? 
What does this result allow you to conclude about stability of 

. Consider the following ODE: 

~=0; 


y=—-y-—a’y, (x,y) eR’. 


(a) Compute the flow generated by this vector field and show that all 
trajectories approach the z-axis as t > oo. 

(b) Using the vector field and the trajectories show that (0,0) is a 
Lyapunov stable equilibrium point. 
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(c) Using the function V(x, y) = 3 (a? + y”) as a Lyapunov function, 
use Lyapunov’s theorem to show that (x,y) = (0,0) is Lyapunov 
stable. 

(d) Show that the LaSalle Invariance principle implies that all solutions 
approach the z-axis as t > oo. 


Consider the following two-dimensional autonomous ODE on R?, 
L=—-2, 
y=—a7y, (x,y) eR’. 


Using V(z,y) = $ (a? +y?) as a Lyapunov function, show that the 
origin is a stable equilibrium point. 
Consider the following ODE: 


L=yt+ xz. 

y=a—z* —dy— 22, 

zZ=-z+ xyz, (7.36) 
where 6 > O is a parameter. Show that all trajectories with 
initial conditions (2 9,yo,0) approach one of the points (1,0,0), 
(—1,0,0), (0,0,0). (Hint: Apply the LaSalle Invariance principle and 

2 
use the function V(x, y) = 4 — x + 2). 
Consider the ODE: 
g=-z, «reER. 


Illustrate five ways to show that the equilibrium point « = 0 is asymp- 
totically stable. (Hint: Behavior of the explicit analytical form of the 
trajectories, the sign of the vector field, linearization, Lyapunov’s 
method, the LaSalle invariance principle.) 


Chapter 8 


Bifurcation of Equilibria, I 


WE WILL NOW STUDY THE TOPIC OF BIFURCATION OF EQUILIBRIA OF 
AUTONOMOUS VECTOR FIELDS, or “what happens as an equilibrium point 
loses hyperbolicity as a parameter is varied?” We will study this question 
through a series of examples, and then consider what the examples teach 
us about the “general situation” (and what this might be). 


Example 22 (The Saddle-Node Bifurcation). Consider the following 
nonlinear, autonomous vector field on R?: 


& = p— 2’, 


y =—Y, (x,y) € R? (8.1) 


where y is a (real) parameter. The equilibrium points of (8.1) are given 
by: 


(2,4) = (VH,9), (— VE, 0). (8.2) 


It is easy to see that there are no equilibrium points for w < 0, one equi- 
librium point for = 0, and two equilibrium points for p > 0. 
The Jacobian of the vector field evaluated at each equilibrium point is 


given by: 
(\/7, 0) : a a (8.3) 
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from which it follows that the equilibria are hyperbolic and asymptotically 
stable for 44 > 0, and nonhyperbolic for p = 0. 


(V0): es ") 


(8.4) 
from which it follows that the equilibria are hyperbolic saddle points for 
pt > 0, and nonhyperbolic for 4 = 0. We emphasize again that there are no 
equilibrium points for uz < 0. 

As a result of the “structure” of (8.1) we can easily represent the behav- 
ior of the equilibria as a function of in a bifurcation diagram. That is, 
since the 2 and y components of (8.1) are “decoupled”, and the change 
in the number and stability of equilibria us completely captured by the « 
coordinates, we can plot the x component of the vector field as a function 
of 4, as we show in Fig. 8.1. 

In Fig. 8.2 we illustrate the bifurcation of equilibria for (8.1) in the ay 
plane. 

This type of bifurcation is referred to as a saddle-node bifurcation (occa- 
sionally it may also be referred to as a fold bifurcation or tangent bifurca- 
tion, but these terms are used less frequently). 

The key characteristic of the saddle-node bifurcation is the following. 
As a parameter (1) is varied, the number of equilibria change from zero to 
two, and the change occurs at a parameter value corresponding to the two 
equilibria coalescing into one nonhyperbolic equilibrium. 

jis called the bifurcation parameter and = 0 is called the bifurcation 
point. 


Fig. 8.1. Bifurcation diagram for (8.1) in the y-a# plane. The curve of equilibria is 
given by ss = x”. The dashed line denotes the part of the curve corresponding to unsta- 
ble equilibria, and the solid line denotes the part of the curve corresponding to stable 
equilibria. 
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u>0 


Pad 


Fig. 8.2. Bifurcation diagram for (8.1) in the xy plane for up < 0, w = 0, and pw > 0. 
Compare with Fig. 8.1. 


Example 23 (The Transcritical Bifurcation). Consider the following 
nonlinear, autonomous vector field on R?: 


2 


= pe-— sz, 


y = = U5 (x, y) € R?, (8.5) 


where y is a (real) parameter. The equilibrium points of (8.5) are given 
by: 


(x, y) = (0, 0), (Lu, 0). (8.6) 
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The Jacobian of the vector field evaluated at each equilibrium point is 


given by: 
(0,0) : ( | (8.7) 


(11,0) : @: ) (8.8) 


from which it follows that (0,0) is asymptotically stable for w <0, anda 
hyperbolic saddle for 4 > 0, and (1,0) is a hyperbolic saddle for uw < 0 and 
asymptotically stable for ~ > 0. These two lines of fixed points cross at 
pt = 0, at which there is only one, nonhyperbolic fixed point. 

In Fig. 8.3 we show the bifurcation diagram for (8.5) in the y-« plane. 

In Fig. 8.4 we illustrate the bifurcation of equilibria for (8.5) in the 7—y 
plane for pp <0, w =0, and p > 0. 

This type of bifurcation is referred to as a transcritical bifurcation. 

The key characteristic of the transcritical bifurcation is the following. 
As a parameter (1) is varied, the number of equilibria change from two 
to one, and back to two, and the change in number of equilibria occurs at 
a parameter value corresponding to the two equilibria coalescing into one 
nonhyperbolic equilibrium. 


Example 24 (The (Supercritical) Pitchfork Bifurcation). Consider 
the following nonlinear, autonomous vector field on R?: 


& = po — 2, 


y S'= 95 (x,y) € R?, (8.9) 


Fig. 8.3. Bifurcation diagram for (8.5) in the w-x plane. The curves of equilibria are 
given by . = x and « = 0. The dashed line denotes unstable equilibria, and the solid 
line denotes stable equilibria. 
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u 


Pal 


>0 y 
Fig. 8.4. Bifurcation diagram for (8.1) in the xy plane for up < 0, w = 0, and pw > 0. 
Compare with Fig. 8.3. 


where y is a (real) parameter. The equilibrium points of (8.9) are given 
by: 


(3; y) = (0, 0), (JH, 0), (-VH, 0) (8.10) 
The Jacobian of the vector field evaluated at each equilibrium point is 
given by: 
Bb O 
0,0): 8.11 
(0,0) (; (8.11) 


raat 


+,/f,0) : (i *) (8.12) 
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from which it follows that (0,0) is asymptotically stable for  < 0, and 
a hyperbolic saddle for 4 > 0, and (+,/,0) are asymptotically stable for 
js > 0, and do not exist for yp < 0. These two curves of fixed points pass 
through zero at 44 = 0, at which there is only one, nonhyperbolic fixed 


point. 
In Fig. 8.5 we show the bifurcation diagram for (8.9) in the u—a plane. 
In Fig. 8.6, we illustrate the bifurcation of equilibria for (8.9) in the 
z-y plane for uw <0, w= 0, and p > 0. 


Example 25 (The (Subcritical) Pitchfork Bifurcation). Consider 
the following nonlinear, autonomous vector field on R?: 


b=pot+e*, 
y =—Y, (x,y) € R’, (8.13) 


where y is a (real) parameter. The equilibrium points of (8.9) are given 
by: 


(x,y) = (0, 0), (V—H, 0), (—V—n, 0). (8.14) 


The Jacobian of the vector field evaluated at each equilibrium point is 
given by: 


(8.15) 


(8.16) 


Fig. 8.5. Bifurcation diagram for (8.9) in the w-x plane. The curves of equilibria are 
given by = 2?, and a =0. The dashed line denotes unstable equilibria, and the solid 
line denotes stable equilibria. 
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Fig. 8.6. Bifurcation diagram for (8.9) in the xy plane for up < 0, = 0, and pw > 0. 
Compare with Fig. 8.5. 


from which it follows that (0,0) is asymptotically stable for 4 < 0, and 
a hyperbolic saddle for > 0, and (+,/—j4,0) are hyperbolic saddles for 
pi <0, and do not exist for y > 0. These two curves of fixed points pass 
through zero at 4 = 0, at which there is only one, nonhyperbolic fixed 


point. 
In Fig. 8.7, we show the bifurcation diagram for (8.13) in the p—« plane. 
In Fig. 8.8, we illustrate the bifurcation of equilibria for (8.9) in the 
x-y plane for uw < 0, 4 = 0, and p > 0. 


We note that the phrase supercritical pitchfork bifurcation is also 
referred to as a soft loss of stability and the phrase subcritical pitchfork 
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Fig. 8.7. Bifurcation diagram for (8.13) in the z-x plane. The curves of equilibria are 
given by 4 = —a?, and x = 0. The dashed curves denote unstable equilibria, and the 
solid line denotes stable equilibria. 
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Fig. 8.8. Bifurcation diagram for (8.13) in the x~y plane for uw < 0, w = 0, and p > 0. 
Compare with Fig. 8.7. 
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bifurcation is referred to as a hard loss of stability. What this means is the 
following. In the supercritical pitchfork bifurcation as jz goes from negative 
to positive the equilibrium point loses stability, but as ~ increases past zero 
the trajectories near the origin are bounded in how far away from the ori- 
gin they can move. In the subcritical pitchfork bifurcation, the origin loses 
stability as increases from negative to positive, but trajectories near the 
unstable equilibrium can become unbounded. 
It is natural to ask the question, 


‘WHAT IS COMMON ABOUT THESE THREE EXAMPLES OF BIFURCATIONS 
OF FIXED POINTS OF ONE-DIMENSIONAL AUTONOMOUS VECTOR FIELDS?” 
We note the following: 


e A necessary (but not sufficient) for bifurcation of a fixed point is nonhy- 
perbolicity of the fixed point. 

e The “nature” of the bifurcation (e.g. numbers and stability of fixed 
points that are created or destroyed) is determined by the form of the 
nonlinearity. 


But we could go further and ask what is in common about these exam- 
ples that could lead to a definition of the bifurcation of a fixed point for 
autonomous vector fields? From the common features we give the following 
definition. 


Definition 21 (Bifurcation of a fixed point of a one-dimensional 
autonomous vector field). We consider a one-dimensional autonomous 
vector field depending on a parameter, yp. We assume that at a certain 
parameter value it has a fixed point that is not hyperbolic. We say that 
a bifurcation occurs at that “nonhyperbolic parameter value” if for js in a 
neighborhood of that parameter value the number of fixed points and their 
stability changes.* 


Finally, we finish the discussion of bifurcations of a fixed point of 
one-dimensional autonomous vector fields with an example showing that 
a nonhyperbolic fixed point may not bifurcate as a parameter is varied, i.e. 
nonhyperbolicity is a necessary, but not sufficient, condition for bifurcation. 


1Consider this definition in the context of our examples (and pay particular attention 
to the transcritical bifurcation). 
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4 


Fig. 8.9. Bifurcation diagram for (8.17). 


Example 26. We consider the one-dimensional autonomous vector field: 
z=p—cz, «eR, (8.17) 


where jt is a parameter. This vector field has a nonhyperbolic fixed point 
at x = 0 for w = 0. The curve of fixed points in the p-a# plane is given 
by 2 = x°, and the Jacobian of the vector field is —3x?, which is strictly 
negative at all fixed points, except for the nonhyperbolic fixed point at the 
origin. 

In Fig. 8.9 we plot the fixed points as a function of p. 

We see that there is no change in the number or stability of the fixed 
points for 4 > 0 and yu < 0. Hence, no bifurcation. 


Problem Set 8 


1. Consider the following autonomous vector fields on the plane depend- 
ing on a scalar parameter js. Verify that each vector field has a fixed 
point at (a,y) = (0,0) for « = 0. Determine the linearized stability 
of this fixed point. Determine the nature (i.e. stability and number) of 
the fixed points for 4 in a neighborhood of zero. (In other words, carry 
out a bifurcation analysis.) Sketch the flow in a neighborhood of each 
fixed point for values of 4 corresponding to changes in stability and/or 
numbers of fixed points. 


(a) 
& = p+ 1027, 


y= x— dy. 
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& = px + 1027, 
y= u—2y. 


= pote, 

y=-y. 

. Consider the following two-dimensional autonomous ODE: 
&= po—a’*— xy, 
y=a’yty, (2,y) eR’. 

where ys is a parameter. 


(a) Find all equilibria and show that they lie on the x-axis. 

(b) Show that the z-axis is an invariant manifold? 

(c) Show that a transcritical bifurcation occurs as a function of ju. 
(d) Draw an appropriate bifurcation diagram. 


. Consider the ODE: 

£=p+ry—2’, 

y=ay—y?—vy, (ay) ER’, (8.18) 
where ps and v are parameters. 


(a) Compute a one-dimensional invariant manifold for (8.18). 

(b) Show that a saddle-node bifurcation occurs in this problem. What 
is the bifurcation parameter? Sketch the bifurcation diagram and 
indicate the stability of the equilibria. 


. Consider the following two-dimensional autonomous ODE: 
&=—a? + xy? + pa, 
y=arytpy, (2,y) ER’, 

where ys is a parameter. 


(a) Find all equilibria. 

(b) Show that the z-axis and the y-axis are invariant manifolds 
(c) Show that a pitchfork bifurcation occurs as a function of yp. 
(d) Draw an appropriate bifurcation diagram. 
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Chapter 9 
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We have examined fixed points of one-dimensional autonomous vector fields 
where the matrix associated with the linearization of the vector field about 
the fixed point has a zero eigenvalue. 


IT IS NATURAL TO ASK “ARE THERE MORE COMPLICATED BIFURCATIONS, 
AND WHAT MAKES THEM COMPLICATED?”. If one thinks about the exam- 
ples considered so far, there are two possibilities that could complicate 
the situation. One is that there could be more than one eigenvalue of the 
linearization about the fixed point with zero real part (which would nec- 
essarily require a consideration of higher dimensional vector fields), and 
the other would be more complicated nonlinearity (or a combination of 
these two). Understanding how dimensionality and nonlinearity contribute 
to the “complexity” of a bifurcation (and what that might mean) is a very 
interesting topic, but beyond the scope of this course. This is generally a 
topic explored in graduate level courses on dynamical systems theory that 
emphasize bifurcation theory. Here we are mainly just introducing the basic 
ideas and issues with examples that one might encounter in applications. 
Towards that end we will consider an example of a bifurcation that is very 
important in applications — the Poincaré—Andronov—Hopf bifurcation (or 
just Hopf bifurcation as it is more commonly referred to). This is a bifur- 
cation of a fixed point of an autonomous vector field where the fixed point 
is nonhyperbolic as a result of the Jacobian having a pair of purely imag- 
inary eigenvalues, +iw, w #0. Therefore this type of bifurcation requires 
(at least two dimensions), and it is not characterized by a change in the 
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number of fixed points, but by the creation of time dependent periodic 
solutions. We will analyze this situation by considering a specific example. 
References solely devoted to the Hopf bifurcation are the books of Marsden 
and McCracken! and Hassard, Kazarinoff, and Wan.? 

We consider the following nonlinear autonomous vector field on the 
plane: 


& = px — wy + (ax — by)(x? +-y), 


y=wat py + (be +ay)(2?+y), (a,y) ER’, (9.1) 
where we consider a, b, w as fixed constants and pz as a variable parameter. 


The origin, (v,y) = (0,0) is a fixed point, and we want to consider its 
stability. The matrix associated with the linearization about the origin is 


given by: 
( a (9.2) 
Wop 


and its eigenvalues are given by: 


A1,2 =~PEx aw. (9.3) 
Hence, as a function of yz the origin has the following stability properties: 


B<0 sink 
jt =O center (9.4) 


[fu >0- source 


The origin is not hyperbolic at 4 = 0, and there is a change in stability as 
js changes sign. We want to analyze the behavior near the origin, both in 
phase space and in parameter space, in more detail. 

Towards this end we transform (9.1) to polar coordinates using the 
standard relationship between cartesian and polar coordinates: 


x=rcosé, y=rsind (9.5) 


1J. E. Marsden and M. McCracken. The Hopf Bifurcation and Its Applications. 
Applied Mathematical Sciences. Springer-Verlag, 1976. 

2B. D. Hassard, N. D. Kazarinoff, and Y.-H. Wan. Theory and Applications of Hopf 
Bifurcation, Volume 41. CUP Archive, 1981. 
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Differentiating these two expressions with respect to t, and substituting 
into (9.1) gives: 


& = cos6 —résin@ = pr cosé — wr sind 

+ (ar cos 6 — br sin @)r?, (9.6) 
y =7 sind +70 cos@ = wr cos + pr sind 

+ (br cos 6 + ar sin 6)r?, (9.7) 


from which we obtain the following equations for * and 0: 


* = pr+ar®, (9.8) 


r@ = wr + br’, (9.9) 


where (9.8) is obtained by multiplying (9.6) by cos@ and (9.7) by sin@ and 
adding the two results, and (9.9) is obtained by multiplying (9.6) by — sin# 
and (9.7) by cos@ and adding the two results. Dividing both equations by 
r gives the two equations that we will analyze: 


* = pr tar, (9.10) 

6 =w + br’. (9.11) 
Note that (9.10) has the form of the pitchfork bifurcation that we studied 
earlier. However, it is very important to realize that we are dealing with 
the equations in polar coordinates and to understand what they reveal to 
us about the dynamics in the original cartesian coordinates. To begin with, 
we must keep in mind that r > 0. 


Note that (9.10) is independent of 0, i.e. it is a one-dimensional, 
autonomous ODE which we rewrite below: 


¢=pr+ar =r(u+ar’). (9.12) 


The fixed points of this equation are: 


r=0, r=,f—hert. (9.13) 
a 


6=w+b(-*) (9.14) 
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The # component can easily be solved (using rt = \/—&), after which we 
obtain: 


A(t) = (~ — ) t+ 0(0). (9.15) 
Therefore r does not change in time at r = rt and 6 evolves linearly in 
time. But @ is an angular coordinate. This implies that r = r* corresponds 
to a periodic orbit.? 

Using this information, we analyze the behavior of (9.12) by construct- 
ing the bifurcation diagram. There are two cases to consider: a > 0 and 
a<0. 

In Fig. 9.1 we sketch the zeros of (9.12) as a function of 4 for a > 0. 

We see that a periodic orbit bifurcates from the nonhyperbolic fixed 
point at 44 = 0. The periodic orbit is unstable and exists for pw < 0. In 
Fig. 9.2 we illustrate the dynamics in the x — y phase plane. 

In Fig. 9.3 we sketch the zeros of (9.12) as a function of y for a < 0. 

We see that a periodic orbit bifurcates from the nonhyperbolic fixed 
point at yw = 0. The periodic orbit is stable in this case and exists for 
jt > 0. In Fig. 9.4 we illustrate the dynamics in the x — y phase plane. 

In this example, we have seen that a nonhyperbolic fixed point of a 
two-dimensional autonomous vector field, where the nonhyperbolicity arises 
from the fact that the linearization at the fixed point has a pair of pure 
imaginary eigenvalues, +iw, can lead to the creation of periodic orbits as 
a parameter is varied. This is an example of what is generally called the 


Fig. 9.1. The zeros of (9.12) as a function of pu for a > 0. 


3 At this point it is very useful to “pause” and think about the reasoning that led to 
the conclusion that r = r+ is a periodic orbit. 
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Fig. 9.2. Phase plane as a function of yz in the x — y plane for a > 0. 


Fig. 9.3. The zeros of (9.12) as a function of pu for a < 0. 


108 Ordinary Differential Equations: A Dynamical Point of View 


u<0 
y 
xX 
u=0 y 
xX 
u>0 y 
xX 


Fig. 9.4. Phase plane as a function of yz in the x — y plane for a < 0. 


Hopf bifurcation. It is the first example we have seen of the bifurcation of 
an equilibrium solution resulting in time-dependent solutions. 

At this point it is useful to summarize the nature of the conditions 
resulting in a Hopf bifurcation for a two-dimensional, autonomous vector 
field. To begin with, we need a fixed point where the Jacobian associated 
with the linearization about the fixed point has a pair of pure imaginary 
eigenvalues. This is a necessary condition for the Hopf bifurcation. Now 
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just as for bifurcations of fixed points of one-dimensional autonomous vec- 
tor fields (e.g. the saddle-node, transcritical, and pitchfork bifurcations 
that we have studied in the previous chapter) the nature of the bifurca- 
tion for parameter values in a neighborhood of the bifurcation parameter is 
determined by the form of the nonlinearity of the vector field.t We devel- 
oped the idea of the Hopf bifurcation in the context of (9.1), and in that 
example, the stability of the bifurcating periodic orbit was given by the sign 
of the coefficient a (stable for a < 0, unstable for a > 0). In the example the 
stability coefficient was evident from the simple structure of the nonlinear- 
ity. In more complicated examples, i.e. more complicated nonlinear terms, 
the determination of the stability coefficient is more algebraically intensive. 
Explicit expressions for the stability coefficient are given in many dynam- 
ical systems texts. For example, it is given in Guckenheimer and Holmes? 
and Wiggins.® The complete details of the calculation of the stability coef- 
ficient are carried out in the reference in Footnote 7. Problem 2 at the 
end of this chapter explores the nature of the Hopf bifurcation, e.g. the 
number and stability of bifurcating periodic orbits, for different forms of 
nonlinearity. 

Next, we return to the examples of bifurcations of fixed points in one- 
dimensional vector fields and give two examples of one-dimensional vector 
fields where more than one of the bifurcations we discussed earlier can 
occur. 


Example 27. Consider the following one-dimensional autonomous vector 
field depending on a parameter p: 


2 3 
#=p-S+5, xceR. (9.16) 
The fixed points of this vector field are given by: 
ge ae 
=—-— wl 
oe eles (9.17) 


and are plotted in Fig. 9.5. 


4It would be very insightful to think about this statement in the context of the saddle- 
node, transcritical, and pitchfork bifurcations that we studied in the previous chapter. 

5J. Guckenheimer and P. J. Holmes. Nonlinear Oscillations, Dynamical Systems, and 
Bifurcations of Vector Fields, Volume 42. Springer Science & Business Media, 2013. 

6S. Wiggins. Introduction to Applied Nonlinear Dynamical Systems and Chaos, 
Volume 2. Springer Science & Business Media, 2003. 

7B. D. Hassard, N. D. Kazarinoff, and Y.-H. Wan. Theory and Applications of Hopf 
Bifurcation, Volume 41. CUP Archive, 1981. 
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Fig. 9.5. Fixed points of (9.16) plotted in the 4 — a plane. 


The curve plotted is where the vector field is zero. Hence, it is positive 
to the right of the curve and negative to the left of the curve. From this 
we conclude the stability of the fixed points as shown in the figure. 

There are two saddle node bifurcations that occur where GH (<p) = 0. 


These are located at 
1 
(2,1) = (0,0), (1.2). (9.18) 


Example 28. Consider the following one-dimensional autonomous vector 
field depending on a parameter pi: 


3 A 
L= px — > Ap 3° 
og 
=u“ (u- =+5) (9.19) 
The fixed points of this vector field are given by: 
b= a - S (9.20) 
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Fig. 9.6. Fixed points of (9.19) plotted in the 4 — x plane. 


and 
x =0, (9.21) 


and are plotted in the 4 — x plane in Fig. 9.6. 
In this example we see that there is a pitchfork bifurcation and a saddle- 
node bifurcation. 


Problem Set 9 


1. Consider the following autonomous vector field on the plane: 


& = px — 3y—a(2* + y”)° 


y = 30+ py —y(a* +"), 


where py is a parameter. Analyze possible bifurcations at (x,y) = (0,0) 
for in a neighborhood of zero. (Hint: Use polar coordinates.) 
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2. These exercises are from the book by Marsden and McCracken.® Con- 
sider the following vector fields expressed in polar coordinates, i.e. 
(r,@) € R* x $1, depending on a parameter yp. Analyze the stability 
of the origin and the stability of all bifurcating periodic orbits as a func- 
tion of ju. 


(a) 


f= —pr(r t+ p)(r — py), 


6=1. 


3. Consider the following vector field: 


ee 


b=pre-—+—, «£eER, 
ag 
where jz is a parameter. Classify all bifurcations of equilibria and, in the 


process of doing this, determine all equilibria and their stability type. 


8J. E. Marsden and M. McCracken. The Hopf Bifurcation and Its Applications. 
Applied Mathematical Sciences. Springer-Verlag, 1976. 
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4. Consider the following ODE: 
& = px — wy + (ax — by) fa? +y?, 
y = we + py + (be +ay)/22+y?, (x,y) ER’. — (9.22) 


(a) Using the polar coordinate transformation x = rcos0, y = rsin@, 
transform (9.22) to polar coordinates. 

(b) Construct and describe bifurcation diagrams in the r — y plane indi- 
cating the equilibria and periodic orbits for the cases a < 0, a > 0. 


5. Consider the following ODE: 


1 1 
f= pe —wyt (-5: - v) (a? + y7) + (Ge+u) (x? + y7)?, 


1 1 
y=wet+uyt (: a 5) (x? + y’) qr (-« + i) (a + ce ge 
(9.23) 
where (x,y) € R?. 


(a) Using the polar coordinate transformation x = rcos0, y = rsin@, 
transform (9.23) to polar coordinates. 

(b) Construct and describe bifurcation diagrams in the r — y plane indi- 
cating the equilibria and periodic orbits, and their stability. 
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Chapter 10 


Center Manifold Theory 


THIS CHAPTER IS ABOUT CENTER MANIFOLDS, DIMENSIONAL REDUCTION, 
AND STABILITY OF FIXED POINTS OF AUTONOMOUS VECTOR FIELDS.! We 
begin with a motivational example. 


Example 29. Consider the following linear, autonomous vector field on 
IR° x R*: 


& = Ax, 
y= By, (z,y)eER°xR’, (10.1) 


where A is ac Xx c matrix of real numbers having eigenvalues with zero real 
part and B isa sxs matrix of real numbers having eigenvalues with negative 
real part. Suppose we are interested in stability of the nonhyperbolic fixed 
point (#,y) = (0,0). Then that question is determined by the nature of 
stability of « = 0 in the lower dimensional vector field: 


t=Az, cER’. (10.2) 


1Expositions of center manifold theory are mostly found in advanced dynamical systems 
textbooks. It is likely true that all such expositions have their roots in the monographs 
by Henry and Carr. The monograph of Henry is a bit obscure, but it is a seminal work 
in the field. The monograph by Carr is a real jewel. All of the theorems in this chapter 
are taken from Carr, where the proofs can also be found. 
D. Henry. Geometric Theory of Semilinear Parabolic Equations. Lecture Notes in 
Mathematics. Springer Berlin Heidelberg, 1993; and J. Carr. Applications of Centre 
Manifold Theory, Volume 35. Springer Science & Business Media, 2012. 
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This follows from the nature of the eigenvalues of B, and the properties 
that a and y are decoupled in (10.1) and that it is linear. More precisely, 
the solution of (10.1) is given by: 


u(t, x eAty 
ee) Y a. (10.3) 
y(t, yo) e~"yo 
From the assumption of the real parts of the eigenvalues of B having neg- 
ative real parts, it follows that: 


ae 


In fact, 0 is approached at an exponential rate in time. Therefore it follows 
that stability, or asymptotic stability, or instability of « = 0 for (10.2) 
implies stability, or asymptotic stability, or instability of (a, y) = (0,0) for 
(10.1). 

It is natural to ask if such a dimensional reduction procedure holds for 
nonlinear systems. This might seem unlikely since, in general, nonlinear 
systems are coupled and the superposition principle of linear systems does 
not hold. However, we will see that this is not the case. 


INVARIANT MANIFOLDS LEAD TO A FORM OF DECOUPLING THAT RESULTS 
IN A DIMENSIONAL REDUCTION PROCEDURE that gives, essentially, the 
same result as is obtained for this motivational linear example.? This is 
the topic of center manifold theory that we now develop. 


We begin by describing the set-up. It is important to realize that when 
applying these results to a vector field, it must be in the following form. 


= Art f(c,y), 


y= By+g(a,y), (a, y) © R°xR’, (10.4) 


In fact, this is one of the main uses of invariant manifolds. They can play an essential 
role in developing dimensional reduction schemes. The “manifold” part is important 
because it is desirable for the reduced dimensional system to have properties where the 
usual techniques of calculus can be applied. 
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where the matrices A and B have the following properties: 
A-— ¢cxc matrix of real numbers 
having eigenvalues with zero real parts, 
B-— sxs_ matrix of real numbers 


having eigenvalues with negative real parts, 


and f and g are nonlinear functions. That is, they are of order two or 
higher in x and y, as expressed in the following properties: 


f(0,0)=0, = Df(0,0) =0, 


g(0,0)=0, Dg(0,0) = 0, (10.5) 
and they are C”, r as large as required (we will explain what this means 
when we explicitly use this property later on). 

With this set-up (#,y) = (0,0) is a fixed point for (10.4) and we are 


interested in its stability properties. 
The linearization of (10.4) about the fixed point is given by: 


t= Ax, 


y= By, (#,y)€R°xR’. (10.6) 


The fixed point is nonhyperbolic. It has a c-dimensional invariant center 
subspace and a s-dimensional invariant stable subspace given by: 


E® = {(z,y) € R° x R°|y=0}, (10.7) 


E® = {(#,y) € R® x R® |x =0}, (10.8) 


respectively. 

For the nonlinear system (10.4) there is a s-dimensional, C” local invari- 
ant stable manifold passing through the origin and tangent to E* at the 
origin. Moreover, trajectories in the local stable manifold inherit their 
behavior from trajectories in E* under the linearized dynamics in the sense 
that they approach the origin at an exponential rate in time. 

Similarly, there is a c-dimensional C” local invariant center manifold 
that passes through the origin and is tangent to E° at the origin. Hence, 
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Fig. 10.1. The geometry of the stable and center manifolds near the origin. 


the center manifold has the form: 


Wie ((0, 0)) = {(z,y) € R° x R®|y = A(x), R(O) = 0, Dh(O) = 0}, 
(10.9) 


which is valid in a neighborhood of the origin, i.e. for |x| sufficiently small.? 
We illustrate the geometry in Fig. 10.1. 
The application of the center manifold theory for analyzing the behavior 
of trajectories near the origin is based on three theorems: 


e existence of the center manifold and the vector field restricted to the 
center manifold, 

e stability of the origin restricted to the center manifold and its relation 
to the stability of the origin in the full dimensional phase space, 

e obtaining an approximation to the center manifold. 


Theorem 5 (Existence and Restricted Dynamics). There exists a 
C” center manifold of (x,y) = (0,0) for (10.4). The dynamics of (10.4) 


3At this point it would be insightful to consider (10.9) and make sure you understand 
how it embodies the geometrical properties of the local center manifold of the origin that 
we have described. 
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restricted to the center manifold is given by: 
u= Aut f(u,h(u)), weER’, (10.10) 
for |u| sufficiently small. 


A natural question that arises from the statement of this theorem is 
“why did we use the variable ‘u’ when it would seem that ‘x’ would be the 
more natural variable to use in this situation”? Understanding the answer 
to this question will provide some insight and understanding to the nature 
of solutions near the origin and the geometry of the invariant manifolds 
near the origin. The answer is that “x and y are already used as variables 
for describing the coordinate axes in (10.4)”. We do not want to confuse a 
point in the center manifold with a point on the coordinate axis. A point 
on the center manifold is denoted by (x, h(x)). The coordinate wu denotes a 
parametric representation of points along the center manifold. Moreover, 
we will want to compare trajectories of (10.10) with trajectories in (10.4). 
This will be confusing if 2 is used to denote a point on the center mani- 
fold. However, when computing the center manifold and when considering 
(i.e. (10.10)) it is traditional to use the coordinate ‘x’, i.e. the coordinate 
describing the points in the center subspace. This does not cause ambigui- 
ties since we can name a coordinate anything we want. However, it would 
cause ambiguities when comparing trajectores in (10.4) with trajectories in 
(10.10), as we do in the next theorem.* 


Theorem 6. (i) Suppose that the zero solution of (10.10) is stable (asymp- 
totically stable) (unstable), then the zero solution of (10.4) is also stable 
(asymptotically stable) (unstable). (ii) Suppose that the zero solution of 
(10.10) is stable. Then if (x(t), y(t)) is a solution of (10.4) with (x(0), y(0)) 
sufficiently small, then there is a solution u(t) of (10.10) such that as 
t+ o 


x(t) = u(t) + O(e~”), 
h(u(t)) + O(e~"), (10.11) 


< 

— 
+ 

Nae 
l| 


where y > 0 is a constant. 


4If this long paragraph is confusing it would be fruitful to spend some time considering 
each point. There is some useful insight to be gained. 
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Part (i) of this theorem says that stability properties of the origin in 
the center manifold imply the same stability properties of the origin in 
the full dimensional equations. Part (ii) gives much more precise results 
for the case that the origin is stable. It says that trajectories starting at 
initial conditions sufficiently close to the origin asymptotically approach a 
trajectory in the center manifold. 

Now we would like to compute the center manifold so that we can 
use these theorems in specific examples. In general, it is not possible to 
compute the center manifold. However, it is possible to approximate it to 
“sufficiently high accuracy” so that we can verify the stability results of 
Theorem 6 can be confirmed. We will show how this can be done. The 
idea is to derive an equation that the center manifold must satisfy, and 
then develop an approximate solution to that equation. 

We develop this approach step-by-step. 

The center manifold is realized as the graph of a function, 


y=h(z), «cER’, yER’, (10.12) 


i.e. any point (2.,y-), sufficiently close to the origin, that is in the cen- 
ter manifold satisfies y. = h(x-). In addition, the center manfold passes 
through the origin (h(0) = 0) and is tangent to the center subspace at the 
origin (Dh(0) = 0). 

Invariance of the center manifold implies that the graph of the function 
h(x) must also be invariant with respect to the dynamics generated by 
(10.4). Differentiating (10.12) with respect to time shows that (#,y) at 
any point on the center manifold satisfies: 


y = Dh(a)z. (10.13) 


THIS IS JUST THE ANALYTICAL MANIFESTATION OF THE FACT THAT 
INVARIANCE OF A SURFACE WITH RESPECT TO A VECTOR FIELD IMPLIES 
THAT THE VECTOR FIELD MUST BE TANGENT TO THE SURFACE.” 

We will now use these properties to derive an equation that must be 
satisfied by the local center manifold. 

The starting point is to recall that any point on the local center 
manifold obeys the dynamics generated by (10.4). Substituting y = h(x) 


51t would be very insightful to think about this statement in the context of the examples 
from earlier chapters that involved determining invariant sets and invariant manifolds. 
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into (10.1) gives: 
&= Ar+ f(x, h(2)), (10.14) 
y = Bh(x) + g(a,h(x)), (x,y) € R° x R’. (10.15) 


Substituting (10.14) and (10.15) into the invariance condition y = Dh(x)« 
gives: 


Bh(x) + g(x, h(x)) = Dh(x) (Ax + f(x, h(x))), (10.16) 
or 
Dh(2) (Ax + f(x, h(x))) — Bh(x) — g(x, h(x)) = N(h(x) =0. (10.17) 


This is an equation for h(a). By construction, the solution implies invari- 
ance of the graph of h(a), and we seek a solution satisfying the additional 
conditions h(0) = 0 and Dh(0) = 0. The basic result on approximation of 
the center manifold is given by the following theorem. 


Theorem 7 (Approximation). Let ¢:R° > R* be aC! mapping with 


¢(0) =0, D¢d(0) = 9, 


such that 


for some q>1. Then 
|h(x) — d(@)| = O(|a|4) as x0. 


The theorem states that if we can find an approximate solution of 
(10.17) to a specified degree of accuracy, then that approximate solution is 
actually an approximation to the local center manifold, to the same degree 
of accuracy.® 


6 This answers the question of why we said that the original vector field, (10.4), was 
CT, “r as large as required”. r will need to be as large as needed in order to obtain a 
sufficiently accurate approximation to the local center manifold. “Sufficiently accurate” 
is determined by our ability to deduce stability properties of the zero solution of the 
vector field restricted to the center manifold. 
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We now consider some examples showing how these results are applied. 


Example 30. We consider the following autonomous vector field on the 
plane: 


$= g°y— x2’, 


y=-y+a", (x,y) eR’. (10.18) 


or, in matrix form: 


x 0 O £ xy — 2° 
= : 10.19 
GC) G)+("% aang 
We are interested in determining the nature of the stability of (x, y) = (0,0). 
The Jacobian associated with the linearization about this fixed point is: 


0 O 
0 -1/)’ 
which is nonhyperbolic, and therefore the linearization does not suffice to 
determine stability. 
The vector field is in the form of (10.4) 
& = Ax+ f(x,y), 
y=Byt+g(z,y), (ty) ERR, (10.20) 


where 
A=0, B=-1, f(a,y) =a y-—2°, g(e.y) =2". (10.21) 
We assume a center manifold of the form: 
y = h(a) = ax? + bx? + O(a"), (10.22) 
which satisfies h(0) = 0 (“passes through the origin”) and Dh(0) = 0 
(tangent to H° at the origin). A center manifold of this type will require 


the vector field to be at least C® (hence, the meaning of the phrase C’, 
r as large as necessary). 
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Substituting this expression into the equation for the center manifold 
(10.17) (using (10.21)) gives: 


(2ax + 3b? + O(23)) (art + ba® + O(x®) — «°) 
+az" + bx? + O(2*)-— 2? = 0. (10.23) 


In order for this equation to be satisfied the coefficients on each power of 
x rust be zero. Through third order this gives: 


ge? :a—1=0>a=1, 
oe = Gb, (10.24) 


Substituting these values into (10.22) gives the following expression for the 
center manifold through third order: 


y=2° + O(c"). (10.25) 
Therefore the vector field restricted to the center manifold is given by: 
&=a*+O(a°). (10.26) 


Hence, for x sufficiently small, « is positive for « € 0, and therefore the 
origin is unstable. We illustrate the flow near the origin in Fig. 10.2. 


E* = w*((0,0)) 


w “((0,0)) 
loc 


Fig. 10.2. The flow near the origin for (10.19). 
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Example 31. We consider the following autonomous vector field on the 
plane: 


r= xy, 


y=-yt2*, (2,y) eR’, (10.27) 


£ 0 0 x xy 
= 10.2 
CG) L)G)+(B) os 
We are interested in determining the nature of the stability of (x, y) = (0,0). 
The Jacobian associated with the linearization about this fixed point is: 


0 O 
0 -1/)° 
which is nonhyperbolic, and therefore the linearization does not suffice to 


determine stability. 
The vector field is in the form of (10.1) 


or, in matrix form: 


z= Art f(x,y), 
y = By+g(z,y), (ay) ERR, (10.29) 


where 
A=0, B=-1, f(a,y) = zy, g(x,y) = 2°. (10.30) 
We assume a center manifold of the form: 
y = h(x) = az? + br? + O(2*) (10.31) 


which satisfies h(0) = 0 (“passes through the origin”) and Dh(0) = 0 
(tangent to E° at the origin). A center manifold of this type will require 
the vector field to be at least C? (hence, the meaning of the phrase C’, r 
as large as necessary). 
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Substituting this expression into the equation for the center manifold 
(10.17) (using (10.30)) gives: 


(Qaa + 3b? + O(x?))(ax? + br* + O(a*)) + ax? + ba? + O(x*) — x? =0. 
(10.32) 


In order for this equation to be satisfied the coefficients on each power of 
x rust be zero. Through third order this gives: 


z*:a=0, 
ge 2b6-1=0> 6=1. (10.33) 


Substituting these values into (10.31) gives the following expression for the 
center manifold through third order: 


y= 2° + O(z*). (10.34) 
Therefore the vector field restricted to the center manifold is given by: 
&=2°+ O(a"). (10.35) 


Since & is positive for x sufficiently small, the origin is unstable. We 
illustrate the flow near the origin in Fig. 10.3. 


E* = w°((0.0)) 


Ww “((0,0)) 
loc 


Fig. 10.3. The flow near the origin for (10.27). 
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Problem Set 10 
Consider the following autonomous vector field on the plane: 
$= ey — 2’, 
y=—yta®, (2,y) eR’. 


Determine the stability of (x, y) = (0,0) using center manifold theory.’ 
Consider the following autonomous vector field on the plane: 


& = 2’, 
y=-y+2?, (x,y) €R?’. 


Determine the stability of (x,y) = (0,0) using center manifold theory. 
Does the fact that solutions of 4 = 2? “blow up in finite time” influence 
your answer (why or why not)? 
Consider the following autonomous vector field on the plane: 

L=-2z aa y’, 

y= —22?+22y", (2,y) € R’. 
Show that y = x? is an invariant manifold. Show that there is a tra- 
jectory connecting (0,0) to (1,1), ie. a heteroclinic trajectory. 


. Consider the following autonomous vector field on R*: 


r=y, 
j= —a— ay, 
g=—-e¢+22", (,y,2) €R?. 


Determine the stability of (a, y,z) = (0,0,0) using center manifold 
theory.® 


. Consider the following autonomous vector field on R®: 


t=y, 
y= 2-2’ yt zy, 
—z+a2", (a,y,z) eR’. 


z 


7When the equation restricted to the center manifold is one-dimensional, then stability 
can be deduced from the sign of the one-dimensional vector field near the origin. 

8In this problem the vector field restricted to the center manifold is two-dimensional. 
The only techniques we learned for determining stability of a nonhypebolic fixed points 
for vector fields with more than one dimension was Lyapunov’s method and the LaSalle 
invariance principle. 
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Determine the stability of (a,y,z) = (0,0,0) using center manifold 
theory. 
. Consider the following autonomous vector field on R®: 


L=y, 


y=—atzy’, 
Z=—z+x2", (2,y,2) eR’. 


Determine the stability of (a,y,z) = (0,0,0) using center manifold 
theory. 
. Consider the following ODE: 


L=-2 ar y’, 
y= ay? —y?. 
(0,0) is an equilibrium point. 


(a) Compute the Jacobian of the ODE at the origin. 

(b) Show that the linearized ODE has a one-dimensional stable sub- 
space and a one-dimensional center subspace, and sketch them. 

(c) Use center manifold theory to determine the nature of the stability 
of (0,0). 


. Consider the ODE: 
r= xy, 
y=-y—2—2y°, (x,y) ER’. 


(a) Show that (x, y) = (0,0) is the only equilibrium point and it is not 
hyperbolic. 

Show that x = 0 is an invariant manifold. 

Using V(x,y) = $ (a? + y”) what does Lyapunov’s method allow 
you to conclude about stability of (a, y) = (0,0) ? 

(d) Now apply the Lasalle invariant principle using V(z,y) = 
4 (e + y’). What does it allow you to conclude about stability 
of (x,y) = (0,0)? 

Apply center manifold theory to analyze stability of (x, y) = (0,0). 
How does your conclusion compare with what you can conclude 
from the application of Lyapunov’s method and the LaSalle invari- 


maa 
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ance principle? 
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9. Consider the ODE: 
&= xy, 
y=—yta? —+2y?, (2,y) € R?. 


(a) Show that (x,y) = (0,0) a nonhyperbolic equilibrium point. 

(b) Use center manifold theory to analyze the stability of (x, y) = (0,0). 
(c) Show that « = 0 is an invariant manifold. 

(d) Find all the remaining equilibria and classify their stability. 


(e) Sketch the phase portrait. 
10. Consider the ODE: 
¢=—sing—y’, 
y=ay, (x,y) eR’. 


(a) Show that (x,y) = (0,0) a nonhyperbolic equilibrium point. 

(b) Use center manifold theory to analyze stability of (a, y) = (0,0). 
(c) Show that y = 0 is an invariant manifold. 

(d) Sketch the phase portrait near (x,y) = (0,0). 


A 


Jacobians, Inverses of 
Matrices, and Eigenvalues 


In this appendix we collect together some results on Jacobians and 
inverses and eigenvalues of 2 x 2 matrices that are used repeatedly in the 
material. 

First, we consider the Taylor expansion of a vector valued function of 
two variables, denoted as follows: 


F(a, y) ) 2 
(eu) = ( , (2,y) € R*. Al 
n= (Fer). (ew) (A.1) 
More precisely, we will need to Taylor expand such functions through second 
order: 
h 
H(t +h Yo + &) = H (20,49) + DH (to. (K) FOR). (A2) 


The Taylor expansion of a scalar valued function of one variable should 
be familiar to most students at this level. Possibly there is less familiarity 
with the Taylor expansion of a vector valued function of a vector variable. 
However, to compute this, we just Taylor expand each component of the 
function (which is a scalar valued function of a vector variable) in each 
variable, holding the other variable fixed for the expansion in that particular 
variable, and then we gather the results for each component into matrix 
form. 
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Carrying this procedure out for the f(#,y) component of (A.1) gives: 


0 
f(to +h, yo + k) = f(x0, yo +k) + FE (0,40 + k)h + O(h?), 


= f (£0, yo) + Fe (20, vo)k + O(K?) + FF (ae, woh 
+ O(hk) + O(h?). (A.3) 


The same procedure can be applied to g(x,y). Recombining the terms back 
into the vector expresson for (A.1) gives: 


Hey + nap +h) = (S200) 


a a 
54 (x0, yo) 54 (x0, yo) h 
. aa 


a 
52 (x0, yo) Oy (x0, yo) 


Hence, the Jacobian of (A.1) at (ao, yo) is: 


(0, Yo) 5 (xo, yo) 
s (A.5) 


sie as 


2 (0, Yo) Oy (0, Yo) 


which is a 2 x 2 matrix of real numbers. 

We will need to compute the inverse of such matrices, as well as its 
eigenvalues. 

We denote a general 2 x 2 matrix of real numbers: 


a b 
a=(‘ i) a,b,c, dE R. (A.6) 


It is easy to verify that the inverse of A is given by: 


1 d —b 
Al= : A. 
ad — be (“. a ) an) 


Let I denote the 2 x 2 identity matrix. Then the eigenvalues of A are the 
solutions of the characteristic equation: 


det (A— AI) =0. (A.8) 
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where “det” is notation for the determinant of the matrix. This is a 
quadratic equation in \ which has two solutions: 


trA | 


1 


7 


~ 9 


(tr A)? — 4det A, (A.9) 


where we have used the notation: 


tr A= traceA =a+d, 


det A = determinant A = ad — be. 
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B 


Integration of Some Basic 
Linear ODEs 


In this appendix we collect together a few common ideas related to solving, 
explicitly, linear inhomogeneous differential equations. Our discussion is 
organized around a series of examples. 


Example 32. Consider the one-dimensional, autonomous linear vector 
field: 


t=azr, «,a€R. (B.1) 


We often solve problems in mathematics by transforming them into sim- 
pler problems that we already know how to solve. Towards this end, we 
introduce the following (time-dependent) transformation of variables: 


z= ue. (B.2) 


Differentiating this expression with respect to t, and using (B.1), gives the 
following ODE for u: 


u=0, (B.3) 
which is trivial to integrate, and gives: 
u(t) = u(0), (B.4) 
and it is easy to see from (36) that: 


u(0) = «(0). (B.5) 
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Using (36), as well as (B.4) and (B.5), it follows that: 
a(t)e* = u(t) = u(0) = x(0), (B.6) 
or 
x(t) = x(0)e™. (B.7) 


Example 33. Consider the following linear inhomogeneous nonau- 
tonomous ODE (due to the presence of the term b(t)): 


t=ar+d(t), a, «ER, (B.8) 


where b(t) is a scalar valued function of t, whose precise properties we will 
consider a bit later. We will use exactly the same strategy and change of 
coordinates as in the previous example: 


x= ue. (B.9) 
Differentiating this expression with respect to t, and using (B.8), gives: 
“=e *D(t). (B.10) 


(Compare with (B.3).) Integrating (B.10) gives: 
u(t) = u(0) + [ e~ b(t! )dt!. (B.11) 
Now using (B.9) (with the consequence u(0) = 2(0)) with (B.11) gives: 
x(t) = 2(0)e" + e® [ eo ' b(t! )dt!. (B.12) 


Finally, we return to the necessary properties of b(t) in order for this 
unique solution of (B.8) to “make sense”. Upon inspection of (B.12) it 
is clear that all that is required is for the integrals involving b(t) to be 
well-defined. Continuity is a sufficient condition. 


Example 34. Consider the one-dimensional, nonautonomous linear vector 
field: 


t=a(t)r, «ER, (B.13) 


where a(t) is a scalar valued function of t whose precise properties will 
be considered later. The similarity between (B.1) and (B.13) should be 
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evident. We introduce the following (time-dependent) transformation of 
variables (compare with (36)): 

x = uelo at at (B.14) 


Differentiating this expression with respect to t, and substituting (B.13) 
into the result gives: 


& = weso Ue ae! ua(t)eso a(t')at! 
= elo Wea 4 a(t)ar, (B.15) 
which reduces to: 
u=0. (B.16) 
Integrating this expression, and using (B.14), gives: 


u(t) = u(0) = x(0) = x(t)eJo 2)", (B.17) 


a(t) = 2(0)eFo a(t )ae", (B.18) 


As in the previous example, all that is required for the solution to be well- 
defined is for the integrals involving a(t) to exist. Continuity is a sufficient 
condition. 


Example 35. Consider the one-dimensional inhomogeneous nonau- 
tonomous linear vector field: 


t=a(t)e+0(t), «ER, (B.19) 


where a(t), b(t) are scalar valued functions whose required properties will 
be considered at the end of this example. We make the same transformation 
as (B.14): 

x= uel eae (B.20) 
from which we obtain: 


i = b(t)e Jo ade" (B.21) 


Integrating this expression gives: 


t / Wy uw r] 
u(t) = u(0) +f b(t’ )e~ So ae ee ae (B.22) 
0 
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Using (B.20) gives: 
a(t)eJo ae )ae" — (9) 4 i b(t")enJo a(t Jae” ae! (B.23) 
0 
or 
x(t) = x(O)efo a(t )4e’ 4 ele a(e’)at' | “Bie SE a" ae" at (BB) 
0 


As in the previous examples, all that is required is for the integrals involving 
a(t) and b(t) to be well-defined. Continuity is a sufficient condition. 


The previous examples were all one-dimensional. Now we will consider 
two n-dimensional examples. 


Example 36. Consider the n-dimensional autonomous linear vector field: 
t=Azr, «ER", (B.25) 


where A is an x n matrix of real numbers. We make the following trans- 
formation of variables (compare with ): 


a = eAty, (B.26) 


Differentiating this expression with respect to t, and using (B.25), gives: 


u=0. (B.27) 
Integrating this expression gives: 
u(t) = u(0). (B.28) 
Using (B.26) with (B.28) gives: 
u(t) = e~4tx(t) = u(0) = 2(0), (B.29) 
from which it follows that: 
z(t) = e4*x(0). (B.30) 


Example 37. Consider the n-dimensional inhomogeneous nonautonomous 
linear vector field: 


&=Axr+g(t), «ER, (B.31) 
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where g(t) is a vector valued function of t whose required properties will 
be considered later on. We use the same transformation as in the previous 
example: 


z= eAty, (B.32) 
Differentiating this expression with respect to t, and using (B.31), gives: 
a =e“* g(t), (B.33) 
from which it follows that: 


u(t) = u(0) + | e At g(t! dt’, (B.34) 


or, using (B.32): 


a(t) = e4*x(0) + e4# [ eT At g(t! dtl. (B.35) 
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C 


Solutions of Some Second 
Order ODEs Arising in 
Applications: Newton’s 
Equations* 


In this appendix we will illustrate some of the issues associated with the 
solutions of second order ODEs in the setting of a class of second order 
ODEs arising in a familiar physical setting — the classical mechanical 
motion of a particle of constant mass m in one dimension as described 
by Newton’s equations. By “the motion of a particle in one dimension” 
we mean that the particle is restricted to lie on a (one-dimensional) curve. 
If you think hard about this statement you might think that the motion 
of all particles is one-dimensional since the motion traces out a curve in 
space. Actually, this is true. However, in order to take advantage of this 
you must know the curve, i.e. know the motion. In practice, this is usually 
what we are trying to find out. The situations we have in mind here are 
when the forces on a particle are always acting so that at each point of a 
known curve they are tangential to that curve. In particular, the “curve” 
of interest may be a straight line. In this case, the forces act only in the 
direction of this straight line. We could also consider particles constrained 
to move in a circle, as well as other curves. 


“The material in this appendix is adapted from Elementary Classical Mechanics (World 
Scientific, 2023). 
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We will denote the generic coordinate describing the position of the 
particle by “s”. For a particle moving horizontally in the x direction, s 
would just be w. For a particle falling under the influence of gravity s 
would be the typical vertical coordinate, z. For a simple pendulum the 
particle would be constrained to move in a circle and s would be an angular 
coordinate, where the angle is measured from some fixed (say vertical) line. 

Assuming constant mass, Newton’s second law of motion becomes: 


m—, =F. (C.1) 


This is an example of a second order ODE, and all we now need to do is 
“solve it” to obtain the motion, s(t). However, we are getting a bit ahead 
of ourselves, because there is the problem of specifying the right-hand- 
side of (C.1), the F’. This requires an understanding of the physics of the 
system under consideration. But first, we want to consider some strictly 
mathematical issues associated with (C.1). 

In order to specify a solution of a second order ODE uniquely we require 
two constants (which generally will have physical meaning). Why is this? 
Here is an argument that is not generally found in textbooks, but it is pretty 
straightforward. Suppose s(t) is a solution of (C.1) and we are interested 
in the solution near t = tp. So we could consider a Taylor expansion near 
to: 

2 3 

s(t + to) = s(to) + 2etoyt + 53 (toy? + 2 
and the Taylor coefficients are just the derivatives of s(t) evaluated at to. 
Now in what sense does Eq. (C.1) provide the information to completely 
specify (C.2)? Here, “completely specify” would mean to completely spec- 
ify all of the Taylor coefficients. Equation (C.1) provides us with the second 
derivative of s(t), we can repeatedly differentiate it to obtain all the higher 
order derivatives (assuming all of the derivatives that we require exist). 


(tp)t? + (ig)? +---, (C2) 


However, it tells us nothing about s(to) and 44(to). These we must spec- 
ify separately. If to is the initial time we say that we must specify initial 
conditions; the initial position, s(to), and the initial velocity, 8(to).1 

Now for what type of forces can we actually solve (C.1) analytically 


(as opposed to using a computer)? This depends on the “functional form” 


1In this appendix we will assume that all quantities have sufficient regularity properties, 
e.g. continuity, differentiability, in order for the necessary mathematical operations, e.g. 
differentiation, integration, to be valid. 
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Table C.1. Examples of mathematical forms of forces 
for Newton’s equations in one dimension. 


Force function Solvability of Newton’s equations 
F = constant yes 

F = F(t) yes 

F = F(S) yes 

F = F(s) yes 

F = F(S,t) generally no, except for special cases 
F = F(s, t) generally no, except for special cases 
F = F(s,§,t) generally no, except for special cases 


of the force, i.e. how it depends on s, § and t. We summarize the results 
in Table C.1, and then provide some detailed calculations backing up the 
claims. 

Everything was going fine until the last three rows of Table C.1, and 
that requires some explanation. 

There is an important distinction between linear and nonlinear ODEs. 
The distinction being that solutions of linear ODEs are fairly simple, while 
the solutions of nonlinear ODEs may be extremely complicated (in ways 
that can be made mathematically precise). 

For these reasons it is important to understand from the outset whether 
you are dealing with a linear or nonlinear ODE. 

First, recall what we mean by a linear ODE. This means that F’(s, 8, t) 
is a linear function of s and §, plus a function solely of t (which could be 
constant), i.e. 


F(s, 5, t) = (ao + ay(t))s + (bo + by (t))s + Co + c(t), (C.3) 


where ao, bo, Co are constants, and a,(t), bi (#), ci(t) are functions of t. 

So are Newton’s equations solvable with a force of the form of Eq. (C.3)? 
No. The problem comes from the coefficients on the s and s terms. If they 
are constant (i.e. a,(t) = bi (t) = 0), then Newton’s equations can always 
be solved. 

So what is a nonlinear ODE? It is one that is not linear, according to 
our definition above. 

Now let us turn to justifying Table C.1. 


F = constant. Newton’s equations are: 
q 


d*s : 
m—, =F =constant, s(to) = 80, 8(to) = vo, 
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and this is about the easiest differential equation that you could be given 
to solve. To solve it, you just “integrate twice”, as we now show. 


t 
dt = Fd 
mf a(S 7) [ " 


Performing the integrals gives: 


Integrating this equation gives: 


t 
PS Jar = uy f dr + — =f (7 — to)dr. 
> aT to m 


Performing the integrals gives: 


t) = so + vo(t — to) + —(t — to)?. 
s(t) = so + volt — to) + 5 (é— to) 
F = F(t). Newton’s equations are: 
d’s : 
Maa = F(t), s(to) = 50, 8(to) = vo, 


and this is about the second easiest differential equation that you could be 
given to solve. To solve it, you also integrate twice. 


m fd (Be) ar= f econ 


Performing the integrals gives: 


= _ += 
at = Uo 


Integrating this expression gives: 


ey ')dr' = =w f dr’! + — ~ | [ir F(r)drdr’, 
a to m 
s(t) = 89 + vo(t — to) + =f [wi r)drdr’. 


or 
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F = F(s). Newton’s equations are: 


d’s ds . 
maa = F (=) , 8(to) = 80, 8(to) = vo. 
To solve this equation let 
ds 
= — A 
dt! ie) 
then Newton’s equations become: 
du 
— = F(u). C.5 
m= = Flu) (C5) 


We can solve this equation for u(t) (provided we can do the integrals that 
arise), and then integrate u(t) with respect to t to get s(t). 
More precisely, we solve for u(t) by rewriting (C.5) in the following 


u(t) t 
m i) ELE — / dt. 
u(to)=vo F(u) to 
If this integral can be performed (which will depend on F(w)), then we may 


be able to obtain u(t) = 44(t). We integrate this expression from to to t to 
obtain s(t). 


form: 


F = F(s). Newton’s equations are given by: 


—~ =F(s),  s(to) = 80, 8(to) = vo. (C.6) 


Solving this equation requires a certain insight that, fortunately, others 
have had earlier. 
Define the function: 


Viajes / " F(s!)ds', (c.7) 


where c is any constant. Then Eq. (C.6) becomes: 


ds dV 


ma = — a, (8) s(to) = 80, 8(to) = vo. (C.8) 


Notice that: 


(Fe + V(s)) = (1s + *(s)) =0. (C.9) 
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Now it is important to interpret this equation correctly. It says that a 
solution of m§ + 4¢(s) = 0 must also satisfy: 


= +V(s) = constant. (C.10) 


The constant is determined by the initial conditions. This is a very impor- 
tant expression and it is related to “energy” (see also Appendix F). 


F = F(s,t). If we let 
§=uU, 
then Newton’s equations become first order equations for the velocity (u): 
mut = F(u,t), u(to) = vo. 


If these equations could be solved then the velocity could be integrated 
to give the position. Unfortunately, even though they are first order, the 
general equation cannot be solved explicitly (although many “special cases” 
are known that can be solved). However, it is true that all linear first order 
equations can be solved, i.e. equations of the form: 


mu =a(t)ut b(t), u(to) = vo, (C.11) 


where a(t) and b(t) are continuous functions of t (we show this in Appendix 
B). Before demonstrating how this can be solved, let us first simplify this 
equation by getting rid of the annoying mass term (we can restore it later). 
We do this by defining: 


Then (C.11) becomes: 
ua =a(t)ut+O(t), u(to) = vo, (C.12) 


Now the “trick” to solving this equation is due to Johann Bernoulli. 
He proposed to write the solution of (C.12) in the form u(t) = n(t)m(t). 
Substituting this into (C.12) gives: 


rm + mn = a(t)nm+ W(t), u(to) = n(to)m(to) = vo. (C.13) 
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The solution of this equation can be obtained by breaking it into two pieces, 
and solving each piece separately (why?): 


=a(t)n, solve for n, (C.14) 
b(t 
m= {i aus integrate to get m, with n substituted in from above. 
(C.15) 
The solution of (C.14) is given by: 
n(t) = n(to)eto eer (C.16) 
This is then substituted into (C.15), and integrated, to obtain: 
1 t = T alr! \dr”’ 
m(t) = m(to) + — | b(r)e~ Fog ar" ate. (C.17) 
n(to) 


To obtain u(t), we multiply n(t) and m(t) to obtain: 


t — t wt uw 
u(t) = n(t)m(t) = n(to)m(to)elo M4 + ebig WET | Bren Ie Ne a, 
to 


(C.18) 


and remember that 


u(to) = n(to)m(to). 


This expression illustrates the fact that the general solution of (C.12) is 
the sum of a solution to the homogeneous equation: 


= a(t)u, 


which is the first term in the solution (C.18), and a particular solution 
(the second term in the solution (C.18). A particular solution is just any 
solution of: 


= a(t)u + W(t), 


where you do not worry about the initial conditions. The initial conditions 
are then satisfied for the swum of the homogeneous plus particular solution. 


F = F(s,t). Newton’s equations are: 


m—, = F(s,t), s(to) = 80, 8(to) = vo. 
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Equations of this type cannot generally be solved analytically, even if they 
are linear. However, there is one class of systems of this form which always 
have a solution: the linear, constant coefficient systems, i.e. systems of the 
form: 
ds 
— =as+D(t), 
Map + b(t) 


where a is a real number and b(t) is a continuous function of t. 


F = F(s,8,t). Newton’s equations are: 
d’s 

m— 

dt? 

Equations of this type cannot generally be solved analytically, even if they 


= BS..8; 4), s(to) = $0, 8(to) = Vo. 


are linear. However, there is one class of systems of this form which always 
have a solution: the linear, constant coefficient systems, i.e. systems of the 
form: 
ds 
m— =as+bs+c(t), 
72 (t) 


where a and b are real numbers and c(t) is a continuous function of t. 


D 
Finding Lyapunov Functions 


Lyapunov’s method and the LaSalle invariance principle are very power- 
ful techniques, but the obvious question always arises, “how do I find the 
Lyapunov function? The unfortunate answer is that given an arbitrary 
ODE there is no general method to find a Lyapunov function appropriate 
for a given ODE for the application of these methods. 

In general, to determine a Lyapunov function appropriate for a given 
ODE, the ODE must have a structure that lends itself to the construction of 
the Lyapunov function. Therefore the next question is “what is this struc- 
ture?” If the ODE arises from physical modeling there may be an “energy 
function” that is “almost conserved”. What this means is that when cer- 
tain terms of the ODE are neglected, the resulting ODE has a conserved 
quantity, i.e. a scalar valued function whose time derivative along trajecto- 
ries is zero, and this conserved quantity may be a candidate for a Lyapunov 
function. If that sounds vague it is because the construction of Lyapunov 
functions often requires a bit of “mathematical artistry”. We will consider 
this procedure with some examples. Energy methods are important tech- 
niques for understanding stability issues in science and engineering; see, for 
example see the book by Langhaar! and the article by Maschke.? 


1H. L. Langhaar. Energy Methods in Applied Mechanics. John Wiley & Sons Inc, 
1962. 

2B. Maschke, R. Ortega, and A. J. Van Der Schaft. Energy-based Lyapunov functions 
for forced Hamiltonian systems with dissipation. [EEE Transactions on Automatic Con- 
trol 45(8):1498-1502, 2000. 


147 


148 Ordinary Differential Equations: A Dynamical Point of View 


To begin, we consider Newton’s equations for the motion of a particle 
of mass m under a conservative force in one dimension: 


mi = —— (2), xceER. (D.1) 


aimee re a (D.2) 


It is easy to see that the time derivative of the following function is zero 


2 
ie = + &(c), (D.3) 
since 
.  d® . 
E=myy+ mo 
d® d® 
= —y—— (x) + y——(z) = 0. (D.4) 


In terms of dynamics, the function (D.3) has the interpretation as the 
conserved kinetic energy associated with (D.1). 

Now we will consider several examples. In all cases we will simplify 
matters by taking m = 1. 


Example 38. Consider the following autonomous vector field on R?: 
t= y, 


For 6 = 0 (D.5) has the form of (D.1): 


r=Y; 
y= a2, (x,y) € R?. (D.6) 
with 
2 2 
y x 
Ea=a242, D.7 
tS (D.7) 


It is easy to verify that = 0 along the trajectories of (D.6). 
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Now we differentiate E along trajectories of (D.5) and obtain: 
dE 
— = —dy?. D.8 
a y (D.8) 


(D.6) has only one equilibrium point located at the origin. E is clearly 
positive everywhere, except for the origin, where it is zero. Using E as a 
Lyapunov function we can conclude that the origin is Lyapunov stable. If 
we use £ to apply the LaSalle invariance principle, we can conclude that 
the origin is asymptotically stable. Of course, in this case we can linearize 
and conclude that the origin is a hyperbolic sink for 6 > 0. 


Example 39. Consider the following autonomous vector field on R?: 
t=y, 
y=x—2°—dy, 6>0, (2,y) ER’. (D.9) 
For 6 = 0 (D.9) has the form of (D.1): 


ct=—Y, 
y=x—2°, (2,y)€R? (D.10) 
with 
2 2 4 
y 2 fs 
BR=—-—+4+—. D.11 
2 2 * 4 ( ) 


It is easy to verify that — = 0 along trajectories of (D.10). 

The question now is how we will use E to apply Lyapunov’s method 
or the LaSalle invariance principle? (D.9) has three equilibrium points, a 
hyperbolic saddle at the origin for 6 > 0 and hyperbolic sinks at (x,y) = 
+1,0) for 6 > 0 and centers for 6 = 0. So linearization gives us complete 
information for 6 > 0. For 6 = 0, linearization is sufficient to allow us 
to conclude that the origin is a saddle. The equilibria (x, y) = (£1,0) are 
Lyapunov stable for 6 = 0, but an argument involving the function E would 
be necessary in order to conclude this. Linearization allows us to conclude 
that the equilibria (x,y) = (1,0) are asymptotically stable for 6 > 0. 

The function E can be used to apply the LaSalle invariance principle to 
conclude that for 6 > 0 all trajectories approach one of the three equilibria 
as t > Oo. 


— 
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EK 


Center Manifolds Depending 
on Parameters 


In this appendix we describe the situation of center manifolds that depend 
on a parameter. The theoretical framework plays an important role in 
bifurcation theory. 

As when we developed the theory earlier, we begin by describing the set- 
up. As before, it is important to realize that when applying these results 
to a vector field, it must be in the following form. 


L= Ax TT f(x,y, 1); 
y= By+g(z,y,u), (2,y,u) € Rx R* x R’, (E.1) 


where js € R” is a vector of parameters and the matrices A and B have the 
following properties: 


A—cxXc matrix of real numbers 
having eigenvalues with zero real parts, 
B-—sxs matrix of real numbers 


having eigenvalues with negative real parts, 


and f and g are nonlinear functions. That is, they are of order two or 
higher in x, y and 4, as expressed in the following properties: 


£(0,0,0)=0, Df(0,0,0) = 0, 
g(0,0,0)=0, Dg(0,0,0) = 0, (E.2) 
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and they are C’, r as large as is required to compute an adequate approx- 
imation the center manifold. With this set-up (x, y, 4) = (0,0,0) is a fixed 
point for (E.1) and we are interested in its stability properties. 

The conceptual “trick” that reveals the nature of the parameter depen- 
dence of center manifolds is to include the parameter ps as a new dependent 
variable!: 


z= Ax + f(x,y, p), 
fu = 0, 
y= By+g(2,y,m), (2,y,u) € R° x R® x R?, (E.3) 


The linearization of (E.3) about the fixed point is given by: 


& = Ax, 
= 0, 
y= By, (a,y,pu) € R° x R* x R?. (E.4) 


Even after increasing the dimension of the phase space by p dimensions 
by including the parameters as new dependent variables, the fixed point 
(x,y, 4) = (0,0,0) remains a nonhyperbolic fixed point. It has a (c + p)- 
dimensional invariant center subspace and a s-dimensional invariant stable 
subspace given by: 


B® = {(x,y,u) € R° x R* x R” |y = 0}, (E.5) 
E* = {(x,y,u) €R° x R* x R? |e =0, n= 0}, (E.6) 


respectively. 

It should be clear that center manifold theory, as we have already devel- 
oped, applies to (E.3). Including the parameters, jz as additional dependent 
variables has the effect of increasing the dimension of the “center variables” , 
but there is also an important consequence. Since jz are now dependent 
variables they enter into the determination of the nonlinear terms in the 
equations. In particular, terms of the form 

L£omn 


TM; Yk 


1 At this point it may be useful to go back to the first chapter and recall how nonlinearity 
of an ODE is defined in terms of the dependent variable. 
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now are interpreted as nonlinear terms, when €+m-+n > 1, for nonnegative 
integers 0, m, n. We will see this in the example below. 

Now we consider the information that center manifold theory provides 
us near the origin of (E.3). 


1. In a neighborhood of the origin there exists a C” center manifold that is 
represented as the graph of a function over the center variables, h(a, j1), 
it passes through the origin (h(0,0) = 0) and is tangent to the center 
subspace at the origin (Dh(0,0) = 0) 

2. All solutions sufficiently close to the origin are attracted to a trajectory 
in the center manifold at an exponential rate. 

3. The center manifold can be approximated by a power series expansion. 


It is significant that the center manifold is defined in a neighborhood 
of the origin in both the x and ys coordinates since w = 0 is a bifurcation 
value. This means that all bifurcating solutions are contained in the center 
manifold. This is why, for example, that without loss of generality bifur- 
cations from a single zero eigenvalue can be described by a parametrized 
family of one-dimensional vector fields.” 


Example 40. We now consider an example which was Exercise 1b from 
Problem Set 8. 


& = px + 102”, 
ju =0, 
y=ax-2y, (2,y) eR’, eR. (E.7) 


The Jacobian associated with the linearization about (a, yu, y) = (0,0,0) is 
given by: 


00 0 
00 oO}. (E.8) 
a) 


It is easy to check that the eigenvalues of this matrix are 0, 0, and —2 (as we 
would have expected). However, (E.7) is not quite of the form of (E.3) as a 


2This is a very significant statement and it explains why “bifurcation problems” are 
amenable to dimensional reduction. In particular, an understanding of the nature of 
bifurcation of equilibria for autonomous vector fields can be reduced to a lower dimen- 
sional problem, where the dimension of the problem is equal to the number of eigenvalues 
with zero real part. 
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result of there being a 1 in the lower left-hand entry of the Jacobian (E.8). 
Nevertheless, this can be dealt with via a linear transformation obtained 
from the eigenvalues and eigenvectors of the Jacobian (E.8). It can be 
verified that each of its eigenvalues has an eigenvector. It is easily checked 
that two eigenvectors corresponding to the eigenvalue 0 are given by: 


2 
0], (E.9) 
1 
0 
ae (E.10) 
0 


and an eigenvector corresponding to the eigenvalue —2 is given by: 


0 
0 |. (E.11) 
1 


From these eigenvectors, we form the transformation matrix 
2 0 0 
T={0 1 0 (E.12) 
1 01 
with inverse 


eis 


0 
Ot}. (E.13) 
1 


NIF On| 
oro 


The transformation matrix, T’,, defines the following transformation of the 
dependent variables of (E.7): 


x U 2 0 0 U 2u 
w)=Ti{u}l={o 1 0 wl= fl ; (E.14) 
y Vv 1 0 1 7) utu 
It then follows that the transformed vector field has the form: 
uw 00 O\ /u y(2u) + 10(2u)? 
au l]= {0 0 0 uw] + TT"! 0 
0 0 O —-2 v 0 


(E.15) 
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or 
u 00 O\ fu 3 9 O\ foun + 40u2 
fl]={0 0 0 | + 0 1 0 0 , (E.16) 
b 00 -2/ \v -201 0 
or 
u = put 20u?, 
= 0, 
@ = —2u — pu — 20v?, (E.17) 


from which one sees the form of the transcritical bifurcation that is captured 
on the center manifold. 
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Dynamics of Hamilton’s 
Equations 


In this appendix we give a brief introduction to some of the characteristics 
and results associated with Hamiltonian differential equations (or, Hamil- 
ton’s equations or Hamiltonian vector fields). The Hamiltonian formulation 
of Newton’s equations reveals a great deal of structure about dynamics and 
it also gives rise to a large amount of deep mathematics that is the focus 
of much contemporary research. 

Our purpose here is not to derive Hamilton’s equations from Newton’s 
equations. Discussions of that can be found in many textbooks on mechan- 
ics (although it is often considered “advanced mechanics”). For example, 
a classical exposition of this topic can be found in the classic book of 
Landau,! and more modern expositions can be found in Abraham and 
Marsden? and Arnold.* Rather, our approach is to start with Hamilton’s 
equations and to understand some simple aspects and consequences of the 
special structure associated with Hamilton’s equations. Towards this end, 
our starting point will be Hamilton’s equations. Keeping with the simple 
approach throughout these lectures, our discussion of Hamilton’s equations 
will be for two-dimensional systems. 

We begin with a scalar valued function defined on R? 


H=H(q,p), (q,p) € R’. (F.1) 


1L. D. Landau and E. M. Lifshitz. Classical Mechanics, 1960. 

?R. Abraham and J. E. Marsden. Foundations of Mechanics. Benjamin/Cummings 
Publishing Company Reading, Massachusetts, 1978. 

3V. 1. Arnol’d. Mathematical Methods of Classical Mechanics, Volume 60. Springer 
Science & Business Media, 2013. 
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This function is referred to as the Hamiltonian. From the Hamiltonian, 
Hamilton’s equations take the following form: 


OH 


q= Bp (bP) 
: OH 
p= Gq (bP) (q,p) € R?. (F.2) 


The form of Hamilton’s equations implies that the Hamiltonian is constant 
on trajectories. This can be seen from the following calculation: 


dH OH. 0H 


dt Og ? Op _ 
OHOH OHOH 
Oq Op Op Og ES) 


Furthermore, this calculation implies that the level sets of the Hamiltonian 
are invariant manifolds. We denote the level set of the Hamiltonian as: 


He = {(4,p) € R*| H(a,p) = E}. (F.4) 


In general, the level set is a curve (or possibly an equilibrium point). Hence, 
in the two-dimensional case, the trajectories of Hamilton’s equations are 
given by the level sets of the Hamiltonian. 

The Jacobian of the Hamiltonian vector field (F.2), denoted J, is 
given by: 


OH OH 

a OqOp Op? 
Hap)s | oer), (F.5) 

OG  — Opaq 


at an arbitrary point (q,p) € R?. Note that the trace of J(q,p), denoted 
trJ(q,p), is zero. This implies that the eigenvalues of J(q,p), denoted by 
A1,2,; are given by: 


A1,2 = +,/—det J(q,D), (F.6) 


where detJ(q,p) denotes the determinant of J(q,p). Therefore, if (qo, po) 
is an equilibrium point of (F.1) and detJ(qo, po) 4 0, then the equilibrium 
point is a center for detJ(qo,po) > 0 and a saddle for det.J(qo, po) < 0.4 


4Constraints on the eigenvalues of the matrix associated with the linearization of a 
Hamiltonian vector field at a fixed point in higher dimensions are described in Abraham 
and Marsden or Wiggins. 

R. Abraham and J. E. Marsden. Foundations of Mechanics. Benjamin/Cummings 
Publishing Company Reading, Massachusetts, 1978; and S. Wiggins. Introduction 
to Applied Nonlinear Dynamical Systems and Chaos, Volume 2. Springer Science & 
Business Media, 2003. 
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Next we describe some examples of two-dimensional, linear autonomous 
Hamiltonian vector fields. 


Example 41 (The Hamiltonian Saddle). We consider the Hamilto- 
nian: 


aN 
H(ap)=5(P-7)=Z5-ge+a, @peR (F.7) 
with A} > 0. From this Hamiltonian, we derive Hamilton’s equations: 

. OEE 

q= 5, (DP) = rv, 
P 
OH 

Dp DG (q,p) = aq, (F.8) 


or in matrix form: 


Geel: 


The origin is a fixed point, and the eigenvalues associated with the lin- 
earization are given by +A. Hence, the origin is a saddle point. The value 
of the Hamiltonian at the origin is zero. We also see from (F.7) that the 
Hamiltonian is zero on the lines p — gq = 0 and p+q = 0. These are the 


unstable and stable manifolds of the origin, respectively. The phase por- 
trait is illustrated in Fig. F.1. 

The flow generated by this vector field is given in Chapter 2, Problem 
Set 2, Problem 6. 


Fig. F.1. The phase portrait of the linear Hamiltonian saddle. The stable manifold of 
the origin is given by p— q = O and the unstable manifold of the origin is given by 
p+q=0. 
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Example 42 (The Hamiltonian Center). We consider the Hamilto- 
nian: 


a) 
Hap)= 5+), @GpeR (F.10) 
with w > 0. From this Hamiltonian, we derive Hamilton’s equations: 
. OH 
q= 3, (GP) = wp, 
P 
OH 
) = ——— =— F.11 
p Da (q,p) = —wq, (F.11) 


or, in matrix form: 


()) 7 Ls 3) (4) (F.12) 


The level sets of the Hamiltonian are circles, and are illustrated in Fig. F.2. 
The flow generated by this vector field is given in Chapter 2, Problem 
Set 2, Problem 5. 


We will now consider two examples of bifurcation of equilibria in 
two-dimensional Hamiltonian systems. Bifurcation associated with one 
zero eigenvalue (as we studied in Chapter 8) is not possible since, fol- 
lowing (F.6), if there is one zero eigenvalue, the other eigenvalue must also 
be zero. We will consider examples of the Hamiltonian saddle-node and 


) ) 


Fig. F.2. The phase portrait for the linear Hamiltonian center. 
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Hamiltonian pitchfork bifurcations. Discussions of the Hamiltonian ver- 
sions of these bifurcations can also be found in Golubitsky et al.° 


Example 43 (Hamiltonian saddle-node bifurcation). We consider 
the Hamiltonian: 


2 3 


where X is considered to be a parameter that can be varied. From this 
Hamiltonian, we derive Hamilton’s equations: 


_ On | 
q ap P; 
_ OH : 


The fixed points for (F.14) are: 


(q,p) = (V2, 0), (F.15) 


from which it follows that there are no fixed points for ’ < 0, one fixed 
point for \ = 0, and two fixed points for \ > 0. This is the scenario for a 
saddle-node bifurcation. 

Next we examine stability of the fixed points. The Jacobian of (F.14) 


is given by: 
0 1 
. F.16 
e ») eee 


The eigenvalues of this matrix are: 


A1,2 =my —24q. 


Hence (q,p) = (—VX, 0) is a saddle, (q, p) = (WX, 0) is a center, and (q, p) = 
(0,0) has two zero eigenvalues. The phase portraits are shown in Fig. F.3. 


5M. Golubitsky, I. Stewart, and J. Marsden. Generic bifurcation of Hamiltonian sys- 
tems with symmetry. Physica D: Nonlinear Phenomena, 24(1-3):391—405, 1987. 
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Fig. F.3. The phase portraits for the Hamiltonian saddle-node bifurcation. 


Example 44 (Hamiltonian pitchfork bifurcation). We consider the 
Hamiltonian: 

2 2 4 
Pp qd q 
——-jA—-+— F.17 
Se ae ©. (F.17) 
where is considered to be a parameter that can be varied. From this 
Hamiltonian, we derive Hamilton’s equations: 


H(q,p) = 


q= Op = Pp, 

; OH 

ps eo (F.18) 
q 


The fixed points for (F.18) are: 


(q,p) = (0,0), (EWA, 0), (F.19) 
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from which it follows that there is one fixed point for \ < 0, one fixed 
point for \ = 0, and three fixed points for A > 0. This is the scenario for a 
pitchfork bifurcation. 

Next we examine stability of the fixed points. The Jacobian of (F.18) 


is given by: 
0 1 
‘ (F.20) 
\—3q? 0 


The eigenvalues of this matrix are: 


A1,2 =H=tV/rA- 3q?. 


Hence (q,p) = (0,0) is a center for \ < 0, a saddle for \ > 0 and has two 
zero eigenvalues for \ = 0. The fixed points (q,p) = (WA, 0) are centers for 
A’ > 0. The phase portraits are shown in Fig. F.4. 


Pp 


Fig. F.4. The phase portraits for the Hamiltonian pitchfork bifurcation. 
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We remark that, with a bit of thought, it should be clear that in two 
dimensions there is no analog of the Hopf bifurcation for Hamiltonian vector 
fields similar to the situation we analyzed earlier in the non-Hamiltonian 
context. There is a situation that is referred to as the Hamiltonian Hopf 
bifurcation, but this notion requires at least four dimensions, see Van Der 
Meer.® 

In Hamiltonian systems a natural bifurcation parameter is the value of 
the level set of the Hamiltonian, or the “energy”. From this point of view 
perhaps a more natural candidate for a Hopf bifurcation in a Hamiltonian 
system is described by the Lyapunov subcenter theorem, see Kelley.” The 
setting for this theorem also requires at least four dimensions, but the 
associated phenomena occur quite often in applications. 


6 J.-C. Van Der Meer. The Hamiltonian Hopf Bifurcation. Springer, 1985. 
TA. Kelley. On the Liapounov subcenter manifold. Journal of Mathematical Analysis 
and Applications, 18(3):472—478, 1967. 
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A Brief Introduction to the 
Characteristics of Chaos 


In this appendix we will describe some aspects of the phenomenon of chaos 
as arising in ODEs. Chaos is one of those notable topics that crosses disci- 
plinary boundaries in mathematics, science, and engineering and captures 
the intrigue and curiousity of the general public. Numerous popularizations 
and histories of the topic, from different points of view, have been written; 
see, for example the books by Lorenz,! Diacu and Holmes,? Stewart,? and 
Gleick.4 

Our goal here is to introduce some of the key characteristics of chaos 
based on notions that we have already developed so as to frame possible 
future directions of studies that the student might wish to pursue. Our 
discussion will be in the setting of a flow generated by an autonomous 
vector field. 

The phrase “chaotic behavior” calls to mind a form of randomness 
and unpredictability. But keep in mind, we are working in the setting of, 
i.e. our ODE satisfies the criteria for existence and uniqueness of solu- 
tions. Therefore specifying the initial condition exactly implies that the 


1E. N. Lorenz. The Essence of Chaos. University of Washington Press, Seattle, 1993. 

?F, Diacu and P. Holmes. Celestial Encounters: The Origins of Chaos and Stability. 
Princeton University Press, 1996. 

3]. Stewart. Does God Play Dice?: The New Mathematics of Chaos. Penguin UK, 
1997. 

4J. Gleick. Chaos: Making a New Science (Enhanced Edition). Open Road Media, 


2011. 
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future evolution is uniquely determined, i.e. there is no “randomness or 
unpredictability”. The key here is the word “exactly”. Chaotic systems 
have an intrinsic property in their dynamics that can result in slight per- 
turbations of the initial conditions leading to behavior, over time, that is 
unlike the behavior of the trajectory through the original initial condition. 
Often it is said that a chaotic system exhibits sensitive dependence on ini- 
tial conditions. Now this is a lot of words for a mathematics course. Just 
like when we studied stability, we will give a mathematical definition of 
sensitive dependence on initial conditions, and then consider the meaning 
of the definition in the context of specific examples. 

As mentioned above, we consider an autonomous, C", r > 1 vector field 
on R”: 


t= f(x), «ceER", (G.1) 


and we denote the flow generated by the vector field by ¢;(-), and we assume 
that it exists for all time. We let A C R” denote an invariant set for the 
flow. Then we have the following definition. 


Definition 22 (Sensitive dependence on initial conditions). The 
flow ¢;(-) is said to have sensitive dependence on initial conditions on A if 
there exists « > 0 such that, for any x € A and any neighborhood U Cc A 
of x there exists y € U and t > 0 such that |¢:(x) — ¢:(y)| > €. 


Now we consider an example and analyze whether or not sensitive 
dependence on initial conditions is present in the example. 


Example 45. Consider the autonomous linear vector field on R?: 
£= Az, 


with A, w > 0. This is just a standard “saddle point”. The origin is a 
fixed point of saddle type with its stable manifold given by the y-axis (i.e. 
x = 0) and its unstable manifold given by the a-axis (i.e. y = 0). The flow 
generated by this vector field is given by: 


dt(20, Yo) = (oe, yor). (G.3) 


Following the definition, sensitive dependence on initial conditions is 
defined with respect to invariant sets. Therefore, we must identify the 
invariant sets for which we want to determine whether or not they pos- 
sess the property of sensitive dependence on initial condition. 
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The simplest invariant set is the fixed point at the origin. However, 
that invariant set clearly does not exhibit sensitive dependence on initial 
conditions. 

Then we have the one-dimensional stable (y-axis) and unstable mani- 
folds (a-axis). We can consider the issue of sensitive dependence on initial 
conditions on these invariant sets. The stable and unstable manifolds divide 
the plane into four quadrants. Each of these is an invariant set (with a seg- 
ment of the stable and unstable manifold forming part of their boundary), 
and the entire plane (i.e. the entire phase space) is also an invariant set. 

We consider the unstable manifold, y = 0. The flow restricted to the 
unstable manifold is given by 


o1(z, 0) = (xoe™, 0). (G.4) 


It should be clear that the unstable manifold is an invariant set that exhibits 
sensitive dependence on initial conditions. Choose an arbitrary point on the 
unstable manifold, £,. Consider another point arbitrarily close to %1, £2. 
Now consider any € > 0. We have 


|e(@1, 0) — b+(Z2, 0)| = |Z1 — Zale’. (G.5) 


Now since |%1 — Z| is a fixed constant, we can clearly find a t > 0 such 
that 


|Z — Eole*t =e. (G.6) 


Therefore, the invariant unstable manifold exhibits sensitive dependence on 
initial conditions. Of course, this is not surprising because of the e** term 
in the expression for the flow since this term implies exponential growth in 
time of the x component of the flow. 

The stable manifold, « = 0, does not exhibit sensitive dependence on 
initial conditions since the restriction to the stable manifold is given by: 


$:(0, yo) = (0, yore”), (G.7) 


which implies that neighboring points actually get closer together as t 
increases. 

Moreover, the term e™ implies that the four quadrants separated by the 
stable and unstable manifolds of the origin also exhibit sensitive dependence 
on initial conditions. 

Of course, we would not consider a linear autonomous ODE on the plane 
having a hyperbolic saddle point to be a chaotic dynamical system, even 
though it exhibits sensitive dependence on initial conditions. Therefore, 
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there must be something more to “chaos”, and we will explore this through 
more examples. 

Before we consider the next example we point out two features of this 
example that we will consider in the context of other examples. 


1. The invariant sets that we considered (with the exception of the fixed 
point at the origin) were unbounded. This was a feature of the linear 
nature of the vector field. 

2. The “separation of trajectories” occurred at an exponential rate. There 
was no requirement on the “rate of separation” in the definition of sen- 
sitive dependence on initial conditions. 

3. Related to these two points is the fact that trajectories continue to 
separate for all time, i.e. they never again “get closer” to each other. 


Example 46. Consider the autonomous vector field on the cylinder: 
r=0, 
6=r, (r,0)eRtx st. (G.8) 
The flow generated by this vector field is given by: 
d:(10,90) = (ro, rot + 9). (G.9) 


Note that r is constant in time. This implies that any annulus is an invari- 
ant set. In particular, choose any r,; < rg. Then the annulus 


A= {(r,)ERtx S| <r<rm,oeS'}, (G.10) 


is a bounded invariant set. 
Now choose initial conditions in A, (74,01), (r$,02), with ry <r, < 
rh <1rg. Then we have that: 


|e (7, 01) a (19, 92)| = | (ri, r,t+ 61) ~~ (ro, r,t + 02) |, 
= (ri — 73, (ry — 79)t + (01 — 42). 


Hence we see that the distance between trajectories will grow linearly 
in time, and therefore trajectories exhibit sensitive dependence on ini- 
tial conditions. However, the distance between trajectories will not grow 
unboundedly (as in the previous example). This is because @ is on the 
circle. Trajectories will move apart (in 6, but their r values will remain 
constant) and then come close, then move apart, etc. Nevertheless, this is 
not an example of a chaotic dynamical system. 


A Brief Introduction to the Characteristics of Chaos 169 


Example 47. Consider the following autonomous vector field defined on 
the two-dimensional torus (i.e. each variable is an angular variable): 


6 = Wi, 
62 =w2, (01,02) € S'x St. (G.11) 
This vector field is an example that is considered in many dynamical sys- 
tems courses where it is shown that if ra 
trajectory through any initial condition “densely fills out the torus”. This 
means that given any point on the torus any trajectory will get arbitrarily 
close to that point at some time of its evolution, and this “close approach” 
will happen infinitely often. This is the classic example of an ergodic sys- 
tem, and this fact is proven in many textbooks, e.g. Arnold® or Wiggins.® 
This behavior is very different from the previous examples. For the case 
an an irrational number, the natural invariant set to consider is the entire 
phase space (which is bounded). 

Next we consider the issue of sensitive dependence on initial conditions. 
The flow generated by this vector field is given by: 


is an irrational number, then the 


b1(01, 02) = (wit +01, wot + 42). (G.12) 
We choose two initial conditions, (01,02), (0,05). Then we have 
|Pe(01, 02) — b4(01,02)| = | (wit + 1, wott Oz) — (wit +O, wet + 5)|, 
= |(01 — %, 02 — 05)), 


and therefore trajectories always maintain the same distance from each 
other during the course of their evolution. 


Sometimes it is said that chaotic systems contain an infinite number of 
unstable periodic orbits. We consider an example. 


Example 48. Consider the following two-dimensional autonomous vector 
field on the cylinder: 


d=r, (r,0) € Rt x S?. 


5V.1. Arnold. Ordinary Differential Equations. M.1.T. Press, Cambridge, 1973. ISBN 
0262010372. 

6S. Wiggins. Introduction to Applied Nonlinear Dynamical Systems and Chaos, 
Volume 2. Springer Science & Business Media, 2003. 
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Equilibrium points of the * component of this vector field correspond to 
periodic orbits. These equilibrium points are given by 


/ — 


1 

-, n=0,1,2,3,.... (G.13) 
n 

Stability of the periodic orbits can be determined by computing the Jaco- 
bian of the 7 component of the equation and evaluating it on the periodic 
orbit. This is given by: 


Therefore all of these periodic orbits are hyperbolic and stable for n 
even and unstable for n odd. This is an example of a two-dimensional 
autonomous vector field that contains an infinite number of unstable hyper- 
bolic periodic orbits in a bounded region, yet it is not chaotic. 


Now we consider what we have learned from these four examples. In 
Example 45 we identified invariant sets on which the trajectories exhibited 
sensitive dependence on initial conditions (i.e. trajectories separated at an 
exponential rate), but those invariant sets were unbounded, and the trajec- 
tories also became unbounded. This illustrates why boundedness is part of 
the definition of invariant set in the context of chaotic systems. 

In Example 46 we identified an invariant set, A, on which all trajectories 
were bounded and they exhibited sensitive dependence on initial conditions, 
although they only separated linearly in time. However, the r coordinates 
of all trajectories remained constant, indicating that trajectories were con- 
strained to lie on circles (“invariant circles”) within A. 

In Example 47, for tae an irrational number, every trajectory densely 
fills out the entire phase space, the torus (which is bounded). However, the 
trajectories did not exhibit sensitive dependence on initial conditions. 

Finally, in Example 48, we gave an example having an infinite number of 
unstable hyperbolic orbits in a bounded region of the phase space. We did 
not explicitly examine the issue of sensitive dependence on initial conditions 
for this example. 
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So what characteristics would we require of a chaotic invariant set? 
A combination of Examples 45 and 47 would capture many manifestations 
of “chaotic invariant sets”: 


1. the invariant set is bounded, 

2. every trajectory comes arbitrarily close to every point in the invariant 
set during the course of its evolution in time, and 

3. every trajectory has sensitive dependence on initial condition. 


While simple to state, developing a unique mathematical framework 
that makes these three criteria mathematically rigorous, and provides a 
way to verify them in particular examples, is not so straightforward. 

Property 1 is fairly straightforward, once we have identified a candidate 
invariant set (which can be very difficult in explicit ODEs). If the phase 
space is equipped with a norm, then we have a way of verifying whether or 
not the invariant set is bounded. 

Property 2 is very difficult to verify, as well as to develop a universally 
accepted definition amongst mathematicians as to what it means for “every 
trajectory to come arbitrarily close to every point in phase space during the 
course of its evolution”. Its definition is understood within the context of 
recurrence properties of trajectories. Those can be studied from either the 
topological point of view (see Akin’). or from the point of view of ergodic 
theory (see Katok and Hasselblatt® or Brin and Stuck®). The settings for 
both of these points of view utilize different mathematical structures (topol- 
ogy in the former case, measure theory in the latter case). A book that 
describes how both of these points of view are used in the application of 
mixing is Sturman et al.'° 

Verifying that Property 3 holds for all trajectories is also not straightfor- 
ward. What “all” means is different in the topological setting (“open set” , 
Baire category) and the ergodic theoretic setting (sets of “full measure” ). 


TR. Akin. The General Topology of Dynamical Systems, Volume 1. American Mathe- 
matical Soc., 2010. 

8A. Katok and B. Hasselblatt. Introduction to the Modern Theory of Dynamical Sys- 
tems, Volume 54. Cambridge University Press, 1997. 

9M. Brin and G. Stuck. Introduction to Dynamical Systems. Cambridge University 
Press, 2002. 

10R, Sturman, J. M. Ottino, and S. Wiggins. The Mathematical Foundations of Mixing: 
The Linked Twist Map as a Paradigm in Applications: Micro to Macro, Fluids to Solids, 
Volume 22. Cambridge University Press, 2006. 
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What “sensitive dependence on initial conditions” means is also different 
in each setting. The definition we gave above was more in the spirit of the 
topological point of view (no specific “rate of separation” was given) and the 
ergodic theoretic framework focuses on Lyapunov exponents (“Lyapunov’s 
first method”) and exponential rate of separation of trajectories. 

Therefore we have not succeeded in giving a specific example of an 
ODE whose trajectories behave in a chaotic fashion. We have been able to 
describe some of the issues, but the details will be left for other courses 
(which could be either courses in dynamical systems theory or ergodic the- 
ory or, ideally, a bit of both). But we have illustrated just how difficult it 
can be to formulate mathematically precise definitions that can be verified 
in specific examples. 

All of our examples above were two-dimensional, autonomous vector 
fields. The type of dynamics that can be exhibited by such systems is very 
limited, according to the Poincaré—Bendixson theorem (see Hirsch et al.‘ 
or Wiggins!”). There are a number of variations of this theorem, so we will 
leave the exploration of this theorem to the interested student. 


11M. W. Hirsch, S. Smale, and R. L. Devaney. Differential Equations, Dynamical 
Systems, and an Introduction to Chaos. Academic Press, 2012. 

128. Wiggins. Introduction to Applied Nonlinear Dynamical Systems and Chaos, 
Volume 2. Springer Science & Business Media, 2003. 
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